-- Logs begin at Wed 2022-08-10 10:25:20 UTC, end at Wed 2022-08-10 11:40:57 UTC. -- Aug 10 11:03:15.715321 dv-cinder-852724-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 11:03:15.722789 dv-cinder-852724-1-smb devstack@keystone.service[80600]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 11:03:15 2022] *** Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: nodename: dv-cinder-852724-1-smb Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: machine: x86_64 Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: clock source: unix Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: pcre jit disabled Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: detected number of CPU cores: 4 Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: current working directory: / Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: detected binary path: /usr/bin/uwsgi-core Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: your processes number limit is 47680 Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: your memory page size is 4096 bytes Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: detected max file descriptor number: 2048 Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: lock engine: pthread robust mutexes Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: thunder lock: enabled Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 11:03:15.726577 dv-cinder-852724-1-smb devstack@keystone.service[80600]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 11:03:15.766283 dv-cinder-852724-1-smb devstack@keystone.service[80600]: Python main interpreter initialized at 0x55b9ab3bd9c0 Aug 10 11:03:15.766283 dv-cinder-852724-1-smb devstack@keystone.service[80600]: python threads support enabled Aug 10 11:03:15.766283 dv-cinder-852724-1-smb devstack@keystone.service[80600]: your server socket listen backlog is limited to 100 connections Aug 10 11:03:15.766283 dv-cinder-852724-1-smb devstack@keystone.service[80600]: your mercy for graceful operations on workers is 90 seconds Aug 10 11:03:15.766651 dv-cinder-852724-1-smb devstack@keystone.service[80600]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 11:03:15.766727 dv-cinder-852724-1-smb devstack@keystone.service[80600]: *** Operational MODE: preforking *** Aug 10 11:03:15.766972 dv-cinder-852724-1-smb devstack@keystone.service[80600]: *** uWSGI is running in multiple interpreter mode *** Aug 10 11:03:15.766972 dv-cinder-852724-1-smb devstack@keystone.service[80600]: spawned uWSGI master process (pid: 80600) Aug 10 11:03:15.767179 dv-cinder-852724-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 10 11:03:15.770384 dv-cinder-852724-1-smb devstack@keystone.service[80600]: spawned uWSGI worker 1 (pid: 80613, cores: 1) Aug 10 11:03:15.770384 dv-cinder-852724-1-smb devstack@keystone.service[80600]: spawned uWSGI worker 2 (pid: 80614, cores: 1) Aug 10 11:03:15.770384 dv-cinder-852724-1-smb devstack@keystone.service[80600]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 11:03:21.329482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:03:21.329482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: from cryptography.utils import int_from_bytes Aug 10 11:03:21.330282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:03:21.330282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: from cryptography.utils import int_from_bytes Aug 10 11:03:21.330431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:03:21.330431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: from cryptography.utils import int_from_bytes Aug 10 11:03:21.330866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:03:21.330866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: from cryptography.utils import int_from_bytes Aug 10 11:03:21.380466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:03:21.380656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:03:21.380758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:03:21.380855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] command line args: [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:03:21.380940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:03:21.381022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] command line args: [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:03:21.381096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:03:21.381256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ================================================================================ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:03:21.381346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:03:21.381462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ================================================================================ {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:03:21.381544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] admin_token = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.381720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] admin_token = **** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.381842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_dir = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.381971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] config_dir = [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.382058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.382163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.382251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_source = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.382346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] config_source = [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.382435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] debug = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.382520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] debug = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.382600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.382885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.383033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.383164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.383289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.383412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.383533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.383651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.383779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.383905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] list_limit = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] log_config_append = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_config_append = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] log_dir = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] log_file = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_dir = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.384991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.385211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.385339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.385455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.385455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.385646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.385764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.385890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.386972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387097 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387363 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.387980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.388269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.388400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.388485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] publish_errors = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.388672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.388758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.388915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.389096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.389236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.389344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.389548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] publish_errors = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.389674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.389806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.389941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] standard_threads = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] use_journal = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] use_json = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.390989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] standard_threads = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.391062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] use_stderr = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.391158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] use_syslog = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.391237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.391392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.391476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.391648 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.391727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.391825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_journal = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.391902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.392008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_json = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.392135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.392214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_stderr = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.392372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_syslog = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.392466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.392645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.392805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:03:21.392887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.392960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.393121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.393202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.393359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.393544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.393652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.393844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.393923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.394178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.394257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.394478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.394558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.394805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.394889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.395098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.395184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.395409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.395488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.395715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.395794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.396014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.396116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.396349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.396522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.396665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.396880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.397035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.397210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.397293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.397538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.397649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.397866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.398030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.398165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.398389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.398470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.398732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.398818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.399031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.399117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.399342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.399557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.399637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.399945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.400023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.400215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.400321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.400499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.400626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.400755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.400928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.401016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.401228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.401318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.401461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.401559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.401702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.401813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.401958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.402038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.402211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.402296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.402448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.402538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.402684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.402763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.402935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.403973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.404118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.404199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.404379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.404503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.404613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.404727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.404847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.404952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.405878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.405999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.406935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.407887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.408062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.408149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.408299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.408402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.408828 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.408912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.409988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.410066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.410237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.410324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.410475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.410553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.410717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.410798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.410955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.411982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.412140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.412221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.412400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.412482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.412640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.412720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.412872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.412949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.413109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.413189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.413346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.413427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.413581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.413663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.413818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.413901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.414053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.414142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.414297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.414389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.414537 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.414617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.414776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.414860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.415962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.416992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.417143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.417232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.417384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.417463 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.417621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.417698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.417861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.417949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.418094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.418173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.418329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.418407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.418562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.418649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.418799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.418879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] auth.external = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.419996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.420083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] auth.password = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.420226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] auth.token = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.420328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.420489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.420601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.420749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.420833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.421533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.421692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.external = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.421849 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.421984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.421984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.422135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.422238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.422328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.422471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.422561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.password = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.422716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] credential.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.422797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.token = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.422958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.423045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.423199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.423280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.423445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.423524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.423678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.423759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.423920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424235 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.424985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.425158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.425239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.425411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.425492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.425662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.425750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.425914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.425996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.426151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.426231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.426404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.426483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.426643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] federation.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.426726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.426881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.426962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.427128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.427209 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.427358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.427436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.427595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.427676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.427843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.427930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.428082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.428164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.428362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.428448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.428607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.428698 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.428844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.428924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.429088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.429167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.429335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.429413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.429570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.429658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.429817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.429896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.430055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.430133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.430290 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.430371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.430527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.430607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.430775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.430856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.431964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.432049 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.432196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.432276 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.432452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.432544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.432698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.432778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.432932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.433984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.434139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.434218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.434373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.434462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.434615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.434697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.434853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.434933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.435085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.435173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.435322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.435403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.435564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.435643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.435805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.435894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.436055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.436136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.436288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.436413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.436581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.436710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.436850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.436993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437317 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.437990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.438078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.438221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.438302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.438464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.438544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.438701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.438790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.438938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.439970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.440118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.440206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.440368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.440452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.440620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.440699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.440866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.440958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.441098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.441177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.441336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.441415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.441570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.441656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.441803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.441884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.442043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.442123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.442276 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.442364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.442522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.442600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.442767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.442847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.443936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.444017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.444170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.444249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.444427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.444512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.444658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.444792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.444921 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.445061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.445189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.445326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.445455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.445586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.445586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.445827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.445954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.446090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.446217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.446345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.446473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.446602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.446738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.446877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.447004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.447134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.447262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.447381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.447381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.447636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.447762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.447890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448571 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.448953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.449204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.449333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.449459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.449459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.449705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.449841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.449969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.450096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.450222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.450358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.450485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.450683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.450814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.450951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.451080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.451209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] resource.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.451335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.451470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.451597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.451725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.451853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.451998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.452186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.452419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.452630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.452836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.452974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.453103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.453251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.453385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.453521 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.453650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.453778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.453905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.454032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.454167 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] role.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.454306 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.454306 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.454546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] role.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.454675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.454801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.454936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.455064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.455192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.455326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.455453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.455579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.455715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.455842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.455969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.456112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.456241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.456411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.456549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.456677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.456805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.456931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.457063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.457191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.457331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.457455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.457584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.457710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.457852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.457980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.458116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.458244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.458372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.458498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.458624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.458758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.458888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.459014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.459141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.459267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.459395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.459395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.459653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.459782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.459910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.460037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.460164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.460164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.460433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.460560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.460696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.460824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.460951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.461085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.461214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.461351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.461351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.461592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.461719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.461853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.461983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.462111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.462237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.462366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.462493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.462627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.462755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.462882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.463018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.463146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.463272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] token.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.463408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.463536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.463663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.463790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.463916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.464042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.464177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.464361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.464496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.464623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.464750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.464889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.465027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.465157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.465284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.465410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.465537 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.465664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.465802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.465929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.466055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.466182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.466308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.466433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.466577 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.466706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.466834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.466959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.467090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.467225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.467353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.467479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.468085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.468250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.468483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.468700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.connection = **** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.468841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.468985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.469133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.469264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.469394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.469524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.469649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.469782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.469913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.470043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.470172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.470301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.470430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.470568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.470768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.470896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.471031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.471172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.471312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.471443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.471581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.471713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.471843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.471972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.472101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.472231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.472480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.472608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.472736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.472866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:03:21.474710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:03:21.499522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.499805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.499945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.501011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.501249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.501480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.509599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.511191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.538629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.538860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.540121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.540389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.591129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.591451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.642470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.642699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.643427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.643667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.708134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.708373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.708513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.708651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.708789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.708923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.709071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.709204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.709335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.709467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.709612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.709753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.732139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.732326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.732458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.732588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.732729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.732858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.732986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.733113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.733722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.733941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.734158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.734365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.734499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.734628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.744930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.745375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.758094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.758323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.758545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.758687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.758836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.758970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.759098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.759230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.759361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.759507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.759640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80613) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.759769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.759769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.760010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 11:03:21.776267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.776505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 11:03:21.776850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.776937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.777052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 11:03:21.777125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 11:03:21.777328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.777460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.777592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.777723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 11:03:21.777853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.777997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.778137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.778268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.778397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.778658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.789866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.790146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.790417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.790557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.790690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.790824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.791051 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.791337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.798131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.799017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.801196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.801484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.801778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.802064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.802191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.802347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.802475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.802619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.802752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.802877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.803002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.803128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.803260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.803391 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.803517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.803641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.803765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.803889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.804032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.804264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.804569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.804841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.827665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.828752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.829420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.829710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.830255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.830542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.834319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.834603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.834888 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.835150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.835436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.835722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.841710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.841959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.842335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.842672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.846301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.846594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.846781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.846901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.847078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.847187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.847370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.847474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.847659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.847769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.847949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.848038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.848247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.848350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.848559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.848832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.864692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.864970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.865433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.865719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.868912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.869744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.872025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.872346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.872908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.873211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.877435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.878316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.881524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.883780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.884084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.884402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.884690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.884772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.884971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.885054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.885271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.885356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.885562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.885849 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.886133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.901222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.901509 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.901778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.902037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.902364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.902656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.902931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.903200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.909330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.910729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.910888 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.911171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.912278 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.912584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.913984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.914272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.914569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.914867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.915145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.915381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.915670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.915973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.916272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.916581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.927267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.927554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.927836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.928117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.928423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.928642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.928724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.928930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.929015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.929217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.929500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.929812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.930096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.930401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.946008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.947539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.948995 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.950564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.951914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.954025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.954127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.955498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.955587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.955792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.956084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.957103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.957402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.957692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.962483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.964095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.964179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.965740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.967095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.967388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.967791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.968075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.969265 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.969559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.969854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.970137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.976598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.976890 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.977172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.978289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.978585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.978875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.984145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80613) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.984456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.984743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.985019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.985292 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.985563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.985838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.986048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 11:03:21.986139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.986339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.986484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.986626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.986766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.986905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.987039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.987181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.987302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.987458 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.987577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.987737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.987849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80613) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.988021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.988428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.988718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.988997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.989265 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.989547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:21.989829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 11:03:22.021678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b9ab3bd9c0 pid: 80613 (default app) Aug 10 11:03:22.023552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b9ab3bd9c0 pid: 80614 (default app) Aug 10 11:03:22.024956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e35c-7672-4ad8-876a-617b88d68b04 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:22.025244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e35c-7672-4ad8-876a-617b88d68b04 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:22.025515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89e35c-7672-4ad8-876a-617b88d68b04 None None] PATH_INFO: `/v3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:22.029798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Wed Aug 10 11:03:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:30.299856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3213-2842-47f8-9ec1-06dc981a282d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:30.300387 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3213-2842-47f8-9ec1-06dc981a282d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:30.300470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3213-2842-47f8-9ec1-06dc981a282d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:30.304897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:03:30.310051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:30.310462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:30.310608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:30.383091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: INFO dbcounter [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] Registered counter for database keystone Aug 10 11:03:30.402487 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG oslo_db.sqlalchemy.engines [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:03:30.410031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writer thread running {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:03:30.592162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG passlib.handlers.bcrypt [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80613) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 11:03:30.592528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG passlib.handlers.bcrypt [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80613) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 11:03:30.651656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:30.653309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:30.786638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 11:03:30.924084 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3213-2842-47f8-9ec1-06dc981a282d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:30.993416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: INFO dbcounter [None req-73fa3213-2842-47f8-9ec1-06dc981a282d None None] Registered counter for database keystone Aug 10 11:03:31.014285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG oslo_db.sqlalchemy.engines [None req-73fa3213-2842-47f8-9ec1-06dc981a282d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:03:31.021110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writer thread running {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:03:31.137718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3213-2842-47f8-9ec1-06dc981a282d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:31.142465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92ede1-ce99-4a28-a28c-898f2a331809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:31.143080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92ede1-ce99-4a28-a28c-898f2a331809 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:31.143355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92ede1-ce99-4a28-a28c-898f2a331809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:31.143624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92ede1-ce99-4a28-a28c-898f2a331809 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:31.151484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92ede1-ce99-4a28-a28c-898f2a331809 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:31.204604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WARNING keystone.common.rbac_enforcer.enforcer [None req-af92ede1-ce99-4a28-a28c-898f2a331809 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 11:03:31.204883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92ede1-ce99-4a28-a28c-898f2a331809 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:31.214424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Aug 10 11:03:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:03:31.220806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:31.235210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655757e6-fa26-45ea-83cb-56833b89dd21 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:31.239615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aae257-a2c1-4821-b9a3-edbda2a51527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:31.240741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae257-a2c1-4821-b9a3-edbda2a51527 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:31.241028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae257-a2c1-4821-b9a3-edbda2a51527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:31.241302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aae257-a2c1-4821-b9a3-edbda2a51527 admin admin] PATH_INFO: `/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:31.242759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aae257-a2c1-4821-b9a3-edbda2a51527 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a3cc66b5da04b4f9bc679dee7bed60e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:31.294528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e9aae257-a2c1-4821-b9a3-edbda2a51527 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 11:03:31.294871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aae257-a2c1-4821-b9a3-edbda2a51527 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:31.299565 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Wed Aug 10 11:03:31 2022] GET /identity/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:33.295779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcf3-f7a7-4a44-9fa3-8647d13863ba None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:33.296342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcf3-f7a7-4a44-9fa3-8647d13863ba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:33.296432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fcf3-f7a7-4a44-9fa3-8647d13863ba None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:33.300553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:33.305937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856f871-373b-4621-8bf9-939938b0f2e6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:33.306298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856f871-373b-4621-8bf9-939938b0f2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:33.306492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856f871-373b-4621-8bf9-939938b0f2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:33.328413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-3856f871-373b-4621-8bf9-939938b0f2e6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:33.329904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3856f871-373b-4621-8bf9-939938b0f2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:33.337569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 10 11:03:33.359603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fcf3-f7a7-4a44-9fa3-8647d13863ba None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:33.371491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fcf3-f7a7-4a44-9fa3-8647d13863ba None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:33.376252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1225e5-dca8-4939-a989-6f5f4ec6bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:33.376873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1225e5-dca8-4939-a989-6f5f4ec6bab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:33.377151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1225e5-dca8-4939-a989-6f5f4ec6bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:33.377419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1225e5-dca8-4939-a989-6f5f4ec6bab0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:33.384937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1225e5-dca8-4939-a989-6f5f4ec6bab0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:33.386673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1225e5-dca8-4939-a989-6f5f4ec6bab0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:33.395802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Aug 10 11:03:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:03:33.402279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856f871-373b-4621-8bf9-939938b0f2e6 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:33.411502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856f871-373b-4621-8bf9-939938b0f2e6 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:33.415821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf5f4e-7f2a-4169-a09d-ece2e50250ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:33.416467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5f4e-7f2a-4169-a09d-ece2e50250ae admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:33.416747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5f4e-7f2a-4169-a09d-ece2e50250ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:33.417020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf5f4e-7f2a-4169-a09d-ece2e50250ae admin admin] PATH_INFO: `/v3/users/54c3d35f7ad34e87bf733354f4b0f781` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:33.418308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf5f4e-7f2a-4169-a09d-ece2e50250ae admin admin] RBAC: Authorizing `identity:get_user(user_id=54c3d35f7ad34e87bf733354f4b0f781)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:33.420116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf5f4e-7f2a-4169-a09d-ece2e50250ae admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:33.421680 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Wed Aug 10 11:03:33 2022] GET /identity/v3/users/54c3d35f7ad34e87bf733354f4b0f781 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:35.453169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d01cee-15dc-4376-8d61-59a291a24b12 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:35.453759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d01cee-15dc-4376-8d61-59a291a24b12 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:35.453759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d01cee-15dc-4376-8d61-59a291a24b12 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:35.455029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:35.460093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1832b-d850-43a7-8c24-9526bc06d736 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:35.460548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1832b-d850-43a7-8c24-9526bc06d736 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:35.460648 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1832b-d850-43a7-8c24-9526bc06d736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:35.478508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-98c1832b-d850-43a7-8c24-9526bc06d736 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:35.479651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-98c1832b-d850-43a7-8c24-9526bc06d736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:35.509279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8e39-ab89-4b6f-b388-bc22903adabb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:35.509567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8e39-ab89-4b6f-b388-bc22903adabb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:35.509840 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8e39-ab89-4b6f-b388-bc22903adabb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:35.511141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:03:35.516693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:35.517090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:35.517362 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:35.560271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:35.560735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG passlib.handlers.bcrypt [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80614) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 11:03:35.561656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG passlib.handlers.bcrypt [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80614) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 11:03:35.584086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1832b-d850-43a7-8c24-9526bc06d736 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:35.606898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:35.607273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:35.609044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:35.684146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1832b-d850-43a7-8c24-9526bc06d736 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:35.706505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:03:35.717952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba19d6-c5a7-4359-a753-d5ee7377f7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:35.718583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba19d6-c5a7-4359-a753-d5ee7377f7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:35.718865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba19d6-c5a7-4359-a753-d5ee7377f7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:35.719140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba19d6-c5a7-4359-a753-d5ee7377f7e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:35.728180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:35.730898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba19d6-c5a7-4359-a753-d5ee7377f7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-d5ba19d6-c5a7-4359-a753-d5ee7377f7e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:35.739684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:35.740846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:03:35.741915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:03:35.746502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba19d6-c5a7-4359-a753-d5ee7377f7e6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:35.831490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:35.834990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2859ac-f8d2-4cd8-b0a7-1632ba0d0aca None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:35.837405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:35.849594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba19d6-c5a7-4359-a753-d5ee7377f7e6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:35.872295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae0b3-ea44-46f7-93d2-59e61ccad1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:35.873178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae0b3-ea44-46f7-93d2-59e61ccad1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:35.873460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae0b3-ea44-46f7-93d2-59e61ccad1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:35.873793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae0b3-ea44-46f7-93d2-59e61ccad1e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:35.884771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:35.885371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:35.885645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:35.885920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:35.886585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:35.886880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:35.888258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:35.899455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:35.905820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:35.942914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ae0b3-ea44-46f7-93d2-59e61ccad1e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:35.944491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ae0b3-ea44-46f7-93d2-59e61ccad1e8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:36.047119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 11:03:36.052673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae0b3-ea44-46f7-93d2-59e61ccad1e8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:36.055304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:36.111647 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df164a-2e2a-4427-92c8-65a9b9b3e0f0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:36.144903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822cf3-3a6a-4f7c-b961-5baac6e25651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:36.145533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822cf3-3a6a-4f7c-b961-5baac6e25651 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:36.145814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822cf3-3a6a-4f7c-b961-5baac6e25651 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:36.146087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822cf3-3a6a-4f7c-b961-5baac6e25651 None admin] PATH_INFO: `/v3/users/54c3d35f7ad34e87bf733354f4b0f781` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:36.147210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10822cf3-3a6a-4f7c-b961-5baac6e25651 None admin] RBAC: Authorizing `identity:get_user(user_id=54c3d35f7ad34e87bf733354f4b0f781)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:36.148685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10822cf3-3a6a-4f7c-b961-5baac6e25651 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:36.150235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:35 2022] GET /identity/v3/users/54c3d35f7ad34e87bf733354f4b0f781 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:36.152693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae0b3-ea44-46f7-93d2-59e61ccad1e8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:36.155640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822cf3-3a6a-4f7c-b961-5baac6e25651 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:36.169918 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:36.187775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:36.188672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:36.188955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:36.189229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:36.207237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:36.208717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:03:36.226606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:36.227496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:03:36.228343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:03:36.228343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:03:36.228343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:03:36.228343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:03:36.234385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:36.255398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822cf3-3a6a-4f7c-b961-5baac6e25651 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:36.289722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11bc43-a80a-401d-ba10-b692e27fcef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:36.290196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:36.290363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bc43-a80a-401d-ba10-b692e27fcef4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:36.290668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bc43-a80a-401d-ba10-b692e27fcef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:36.290940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bc43-a80a-401d-ba10-b692e27fcef4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:36.292532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11bc43-a80a-401d-ba10-b692e27fcef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:36.293983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11bc43-a80a-401d-ba10-b692e27fcef4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:36.296021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:36.303236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11bc43-a80a-401d-ba10-b692e27fcef4 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:36.333927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289284e-0cd8-4bfb-9edc-09be7378682b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:36.367483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f06a4d-d99a-417e-81c2-afe9fb39f97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:36.368090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06a4d-d99a-417e-81c2-afe9fb39f97a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:36.368402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06a4d-d99a-417e-81c2-afe9fb39f97a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:36.368677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06a4d-d99a-417e-81c2-afe9fb39f97a None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:36.369326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06a4d-d99a-417e-81c2-afe9fb39f97a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:36.369627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06a4d-d99a-417e-81c2-afe9fb39f97a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:36.371036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06a4d-d99a-417e-81c2-afe9fb39f97a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:36.381790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:36.387941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:36.401496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11bc43-a80a-401d-ba10-b692e27fcef4 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:36.440239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce3168-25b1-41db-a044-2378900434a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:36.440908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3168-25b1-41db-a044-2378900434a4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:36.441187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3168-25b1-41db-a044-2378900434a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:36.441458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3168-25b1-41db-a044-2378900434a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:36.442212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce3168-25b1-41db-a044-2378900434a4 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.domain.id=default, user.id=54c3d35f7ad34e87bf733354f4b0f781) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:36.442518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce3168-25b1-41db-a044-2378900434a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:36.444021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce3168-25b1-41db-a044-2378900434a4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:36.451600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Aug 10 11:03:36 2022] GET /identity/v3/role_assignments?user.id=54c3d35f7ad34e87bf733354f4b0f781&scope.domain.id=default&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:38.710396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9b5f9-5f7e-407d-a8c9-48101f20a6ce None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:38.710939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9b5f9-5f7e-407d-a8c9-48101f20a6ce None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:38.710939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9b5f9-5f7e-407d-a8c9-48101f20a6ce None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:38.712470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:38.723021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7671501-6499-44e7-a3e4-16e8053cf67b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:38.723858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7671501-6499-44e7-a3e4-16e8053cf67b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:38.724410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7671501-6499-44e7-a3e4-16e8053cf67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:38.750773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d7671501-6499-44e7-a3e4-16e8053cf67b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:38.752284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d7671501-6499-44e7-a3e4-16e8053cf67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:38.869111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:03:38.906144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9b5f9-5f7e-407d-a8c9-48101f20a6ce None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:39.020633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3e0e-97ec-447b-a493-500cd584c500 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.021279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3e0e-97ec-447b-a493-500cd584c500 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.021754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3e0e-97ec-447b-a493-500cd584c500 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.023288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:03:39.030462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282cef3-d0f3-45b7-976c-d006fc9aa4d7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.031127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282cef3-d0f3-45b7-976c-d006fc9aa4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.031595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282cef3-d0f3-45b7-976c-d006fc9aa4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.065179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a282cef3-d0f3-45b7-976c-d006fc9aa4d7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:39.068391 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a282cef3-d0f3-45b7-976c-d006fc9aa4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:39.087395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9b5f9-5f7e-407d-a8c9-48101f20a6ce None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:39.120693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:39.154297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4028fe-1531-4f51-80c5-a8a943ca4d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:39.155542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4028fe-1531-4f51-80c5-a8a943ca4d03 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.155828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4028fe-1531-4f51-80c5-a8a943ca4d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.156103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4028fe-1531-4f51-80c5-a8a943ca4d03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.180751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4028fe-1531-4f51-80c5-a8a943ca4d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-da4028fe-1531-4f51-80c5-a8a943ca4d03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:39.187339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:39.188192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:03:39.188983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 12/25] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:03:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:03:39.189963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb46ea2-9fd9-4e52-9d46-764c32585c90 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.190405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb46ea2-9fd9-4e52-9d46-764c32585c90 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.190819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb46ea2-9fd9-4e52-9d46-764c32585c90 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.192175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 13/26] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:39.197462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb46ea2-9fd9-4e52-9d46-764c32585c90 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:39.213230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:03:39.214707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f874ab-9fb8-4ca5-8af7-772469c3fd70 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.215151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f874ab-9fb8-4ca5-8af7-772469c3fd70 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.215566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f874ab-9fb8-4ca5-8af7-772469c3fd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.228624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:39.246378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-12f874ab-9fb8-4ca5-8af7-772469c3fd70 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:39.247552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-12f874ab-9fb8-4ca5-8af7-772469c3fd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:39.352988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb46ea2-9fd9-4e52-9d46-764c32585c90 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:39.361752 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 15/28] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:39.362654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f874ab-9fb8-4ca5-8af7-772469c3fd70 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:39.550511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f874ab-9fb8-4ca5-8af7-772469c3fd70 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:39.554341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:39.554979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.555253 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.555524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.556204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:39.556534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:39.557931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:39.578989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 14/29] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:39.584513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:39.588971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:39.597040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.597497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.597913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.605643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:39.620186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:39.621677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:03:39.656067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:39.657051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:03:39.657867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:03:39.657867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:03:39.657867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:03:39.657867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 16/30] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:39.658092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:39.672020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:39.786274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24a169-98ca-4b30-9664-92a48d29b450 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:39.818998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450326b-f2f2-44a3-9bbd-821db8eeb8a4 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:39.835600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7b3b0-5132-4899-a6b0-94c9c4fb141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:39.836480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b3b0-5132-4899-a6b0-94c9c4fb141a None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.836925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b3b0-5132-4899-a6b0-94c9c4fb141a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.837338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b3b0-5132-4899-a6b0-94c9c4fb141a None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.838160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7b3b0-5132-4899-a6b0-94c9c4fb141a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:39.839679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7b3b0-5132-4899-a6b0-94c9c4fb141a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:39.859138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562334cc-2047-45c9-b7fe-05a3ac62ba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:39.859700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562334cc-2047-45c9-b7fe-05a3ac62ba9f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:39.859979 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562334cc-2047-45c9-b7fe-05a3ac62ba9f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:39.860249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562334cc-2047-45c9-b7fe-05a3ac62ba9f None admin] PATH_INFO: `/v3/users/54c3d35f7ad34e87bf733354f4b0f781` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:39.861403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562334cc-2047-45c9-b7fe-05a3ac62ba9f None admin] RBAC: Authorizing `identity:get_user(user_id=54c3d35f7ad34e87bf733354f4b0f781)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:39.862975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562334cc-2047-45c9-b7fe-05a3ac62ba9f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:39.864861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 17/31] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:39 2022] GET /identity/v3/users/54c3d35f7ad34e87bf733354f4b0f781 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:39.869532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562334cc-2047-45c9-b7fe-05a3ac62ba9f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:39.928022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:39.974005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562334cc-2047-45c9-b7fe-05a3ac62ba9f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:40.010040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523455d-9f8c-4075-b501-78a74ea3b3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:40.011038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523455d-9f8c-4075-b501-78a74ea3b3da None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.011616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523455d-9f8c-4075-b501-78a74ea3b3da None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.012093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523455d-9f8c-4075-b501-78a74ea3b3da None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.012959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523455d-9f8c-4075-b501-78a74ea3b3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:40.013515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523455d-9f8c-4075-b501-78a74ea3b3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:40.015825 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523455d-9f8c-4075-b501-78a74ea3b3da None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:40.036515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 18/32] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:40.038149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0991-e775-42e0-85e0-cc9ca8435803 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.038628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0991-e775-42e0-85e0-cc9ca8435803 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.039111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0991-e775-42e0-85e0-cc9ca8435803 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.040600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 19/33] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:40.041488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a0991-e775-42e0-85e0-cc9ca8435803 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:40.142056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 15/34] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 11:03:39 2022] POST /identity/v3/roles => generated 219 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:03:40.142056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7b3b0-5132-4899-a6b0-94c9c4fb141a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:40.159230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a0991-e775-42e0-85e0-cc9ca8435803 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:40.176922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:40.199263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a5831-d71f-4052-ab7d-9c23869431c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:40.200077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5831-d71f-4052-ab7d-9c23869431c7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.200523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5831-d71f-4052-ab7d-9c23869431c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.200980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5831-d71f-4052-ab7d-9c23869431c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.202872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a5831-d71f-4052-ab7d-9c23869431c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:40.204610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a5831-d71f-4052-ab7d-9c23869431c7 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:40.206729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 20/35] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:40.207885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75745907-aeb6-4a10-965c-4c3d5dc8a70a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.208267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75745907-aeb6-4a10-965c-4c3d5dc8a70a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.208719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75745907-aeb6-4a10-965c-4c3d5dc8a70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.228672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-75745907-aeb6-4a10-965c-4c3d5dc8a70a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:40.230024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-75745907-aeb6-4a10-965c-4c3d5dc8a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:40.286620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:40.290136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7b3b0-5132-4899-a6b0-94c9c4fb141a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:40.311849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 21/36] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:40.313462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94431b2a-ca70-4a44-98c7-0da6581efd8f None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.313856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94431b2a-ca70-4a44-98c7-0da6581efd8f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.314245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94431b2a-ca70-4a44-98c7-0da6581efd8f None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.320008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 22/37] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:40.320990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94431b2a-ca70-4a44-98c7-0da6581efd8f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:40.337844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed627b-98c6-4bbc-a0c4-aa263cd940f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:40.340158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed627b-98c6-4bbc-a0c4-aa263cd940f1 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.340158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed627b-98c6-4bbc-a0c4-aa263cd940f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.340158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed627b-98c6-4bbc-a0c4-aa263cd940f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.340158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed627b-98c6-4bbc-a0c4-aa263cd940f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:40.341846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed627b-98c6-4bbc-a0c4-aa263cd940f1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:40.443751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94431b2a-ca70-4a44-98c7-0da6581efd8f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:40.457173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:40.460799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 16/38] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/projects => generated 301 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:03:40.462180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f019c1-1ebe-47e8-8511-85f996791ab2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.462471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f019c1-1ebe-47e8-8511-85f996791ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.462762 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f019c1-1ebe-47e8-8511-85f996791ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.480071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4664-7db4-455a-93db-773d2d7efc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:40.480840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4664-7db4-455a-93db-773d2d7efc8c None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.481140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4664-7db4-455a-93db-773d2d7efc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.481416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4664-7db4-455a-93db-773d2d7efc8c None admin] PATH_INFO: `/v3/domains/default/users/54c3d35f7ad34e87bf733354f4b0f781/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.482403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-86f019c1-1ebe-47e8-8511-85f996791ab2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:40.483580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c4664-7db4-455a-93db-773d2d7efc8c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=54c3d35f7ad34e87bf733354f4b0f781, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:40.488572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-86f019c1-1ebe-47e8-8511-85f996791ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:40.488712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c4664-7db4-455a-93db-773d2d7efc8c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:40.561724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 17/39] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:40.562571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f019c1-1ebe-47e8-8511-85f996791ab2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:40.652673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:40.671708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f019c1-1ebe-47e8-8511-85f996791ab2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:40.693518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 23/40] 10.222.0.40 () {58 vars in 1361 bytes} [Wed Aug 10 11:03:40 2022] PUT /identity/v3/domains/default/users/54c3d35f7ad34e87bf733354f4b0f781/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:03:40.700154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eee8a-17a2-4e38-b659-9ca20ae91262 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.700154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eee8a-17a2-4e38-b659-9ca20ae91262 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.700154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eee8a-17a2-4e38-b659-9ca20ae91262 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.700154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 24/41] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:40.701086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eee8a-17a2-4e38-b659-9ca20ae91262 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:40.711113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed044f39-6317-445c-b690-f2b641b6f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:40.711770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed044f39-6317-445c-b690-f2b641b6f6f4 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.712086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed044f39-6317-445c-b690-f2b641b6f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.712409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed044f39-6317-445c-b690-f2b641b6f6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.713112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed044f39-6317-445c-b690-f2b641b6f6f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:40.714564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed044f39-6317-445c-b690-f2b641b6f6f4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:40.768893 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 18/42] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/roles => generated 225 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:03:40.769982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837427e-9b9a-400f-a258-85eff170393c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.770273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837427e-9b9a-400f-a258-85eff170393c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.770557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837427e-9b9a-400f-a258-85eff170393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.791090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0837427e-9b9a-400f-a258-85eff170393c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:40.792389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0837427e-9b9a-400f-a258-85eff170393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:40.838009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eee8a-17a2-4e38-b659-9ca20ae91262 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:40.883517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 19/43] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:40.892241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811c15d-64a6-45a0-859c-f036f4c26e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:40.893057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c15d-64a6-45a0-859c-f036f4c26e88 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:40.893399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c15d-64a6-45a0-859c-f036f4c26e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:40.893680 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811c15d-64a6-45a0-859c-f036f4c26e88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:40.894932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811c15d-64a6-45a0-859c-f036f4c26e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:40.896625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811c15d-64a6-45a0-859c-f036f4c26e88 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:40.898463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 25/44] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:40.905092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837427e-9b9a-400f-a258-85eff170393c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:40.912969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811c15d-64a6-45a0-859c-f036f4c26e88 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:40.971330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:41.000465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:41.041784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811c15d-64a6-45a0-859c-f036f4c26e88 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:41.046200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837427e-9b9a-400f-a258-85eff170393c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:41.077908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa0362-cac9-464f-a51a-7f739bbf75f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:41.078618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0362-cac9-464f-a51a-7f739bbf75f5 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:41.078906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0362-cac9-464f-a51a-7f739bbf75f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:41.079191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0362-cac9-464f-a51a-7f739bbf75f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:41.079856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa0362-cac9-464f-a51a-7f739bbf75f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:41.081283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa0362-cac9-464f-a51a-7f739bbf75f5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:41.081501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466493-c009-4400-bbbb-c83b2f2a183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:41.082120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466493-c009-4400-bbbb-c83b2f2a183b None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:41.082398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466493-c009-4400-bbbb-c83b2f2a183b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:41.082670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466493-c009-4400-bbbb-c83b2f2a183b None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:41.083322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67466493-c009-4400-bbbb-c83b2f2a183b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:41.084991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67466493-c009-4400-bbbb-c83b2f2a183b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:41.157178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 26/45] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/roles => generated 223 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:03:41.176356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 20/46] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:03:40 2022] POST /identity/v3/projects => generated 312 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:03:42.742882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24afe62-4c88-443e-a2e7-ffa9137aab1e None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:42.743441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24afe62-4c88-443e-a2e7-ffa9137aab1e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:42.743441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24afe62-4c88-443e-a2e7-ffa9137aab1e None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:42.744796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 27/47] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:42.750048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ae343-8298-4d02-a537-73ac4292d11b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:42.750455 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ae343-8298-4d02-a537-73ac4292d11b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:42.750585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ae343-8298-4d02-a537-73ac4292d11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:42.769960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-806ae343-8298-4d02-a537-73ac4292d11b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:42.771130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-806ae343-8298-4d02-a537-73ac4292d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:42.839740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 21/48] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:42.862584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24afe62-4c88-443e-a2e7-ffa9137aab1e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:42.959235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:42.962908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24afe62-4c88-443e-a2e7-ffa9137aab1e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:42.995459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c223174-898e-4848-871d-6bc9a1d452ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:42.996028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c223174-898e-4848-871d-6bc9a1d452ac None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:42.996336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c223174-898e-4848-871d-6bc9a1d452ac None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:42.996662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c223174-898e-4848-871d-6bc9a1d452ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.006984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c223174-898e-4848-871d-6bc9a1d452ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-7c223174-898e-4848-871d-6bc9a1d452ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:43.011797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:43.015087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:03:43.015832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 28/49] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:43.019422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ae343-8298-4d02-a537-73ac4292d11b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:43.070365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:43.116230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ae343-8298-4d02-a537-73ac4292d11b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:43.150739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5693648-31d4-4824-9c09-cdacae14bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:43.151353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5693648-31d4-4824-9c09-cdacae14bb99 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.151638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5693648-31d4-4824-9c09-cdacae14bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.151918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5693648-31d4-4824-9c09-cdacae14bb99 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.152621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5693648-31d4-4824-9c09-cdacae14bb99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:43.152926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5693648-31d4-4824-9c09-cdacae14bb99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:43.154305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5693648-31d4-4824-9c09-cdacae14bb99 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:43.163085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 22/50] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:43.168406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c223174-898e-4848-871d-6bc9a1d452ac None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:43.191956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65160-f7af-473d-8c77-e704c3df2f6a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.192244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65160-f7af-473d-8c77-e704c3df2f6a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.192549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65160-f7af-473d-8c77-e704c3df2f6a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.193894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 23/51] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:03:43.198627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d319e0-be38-4889-8ff5-4eee66c3d16c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.198913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d319e0-be38-4889-8ff5-4eee66c3d16c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.199190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d319e0-be38-4889-8ff5-4eee66c3d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.217086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13d319e0-be38-4889-8ff5-4eee66c3d16c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:43.218338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13d319e0-be38-4889-8ff5-4eee66c3d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:43.268037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c223174-898e-4848-871d-6bc9a1d452ac None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:43.285017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 24/52] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:03:43.301116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bca25-7a1f-46c4-9054-025badd1f40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:43.301745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bca25-7a1f-46c4-9054-025badd1f40f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.302031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bca25-7a1f-46c4-9054-025badd1f40f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.302307 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bca25-7a1f-46c4-9054-025badd1f40f None admin] PATH_INFO: `/v3/users/54c3d35f7ad34e87bf733354f4b0f781` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.303432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bca25-7a1f-46c4-9054-025badd1f40f None admin] RBAC: Authorizing `identity:get_user(user_id=54c3d35f7ad34e87bf733354f4b0f781)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:43.304919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bca25-7a1f-46c4-9054-025badd1f40f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:43.306478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 29/53] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:43 2022] GET /identity/v3/users/54c3d35f7ad34e87bf733354f4b0f781 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:43.307078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d319e0-be38-4889-8ff5-4eee66c3d16c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:43.312144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bca25-7a1f-46c4-9054-025badd1f40f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:43.339036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:43.352413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:43.407379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d319e0-be38-4889-8ff5-4eee66c3d16c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:43.410977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bca25-7a1f-46c4-9054-025badd1f40f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:43.441774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b7157-afe4-4f32-a148-c91c4ec97b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:43.442409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7157-afe4-4f32-a148-c91c4ec97b8e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.442691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7157-afe4-4f32-a148-c91c4ec97b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.442966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7157-afe4-4f32-a148-c91c4ec97b8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.444068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b7157-afe4-4f32-a148-c91c4ec97b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:43.445166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e277cd-a269-4795-a435-7ed090675d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:43.445578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b7157-afe4-4f32-a148-c91c4ec97b8e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:43.445797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e277cd-a269-4795-a435-7ed090675d23 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.446075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e277cd-a269-4795-a435-7ed090675d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.446344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e277cd-a269-4795-a435-7ed090675d23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.447137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 25/54] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:43.447556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e277cd-a269-4795-a435-7ed090675d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:43.449069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e277cd-a269-4795-a435-7ed090675d23 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:43.455304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 30/55] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:43.455448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b7157-afe4-4f32-a148-c91c4ec97b8e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:43.456398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e277cd-a269-4795-a435-7ed090675d23 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:43.550017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:43.552322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b7157-afe4-4f32-a148-c91c4ec97b8e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:43.555603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e277cd-a269-4795-a435-7ed090675d23 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:43.565446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:43.586857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfa5ba-56e4-44aa-93f7-026bf508bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:43.587475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfa5ba-56e4-44aa-93f7-026bf508bcea None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.587760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfa5ba-56e4-44aa-93f7-026bf508bcea None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.588036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfa5ba-56e4-44aa-93f7-026bf508bcea None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.588718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfa5ba-56e4-44aa-93f7-026bf508bcea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:43.589660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2adeb-0677-4083-ba8d-6a7eb3ec3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:43.590157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfa5ba-56e4-44aa-93f7-026bf508bcea None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:43.590346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2adeb-0677-4083-ba8d-6a7eb3ec3456 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:43.590633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2adeb-0677-4083-ba8d-6a7eb3ec3456 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:43.590909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2adeb-0677-4083-ba8d-6a7eb3ec3456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:43.591743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2adeb-0677-4083-ba8d-6a7eb3ec3456 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.domain.id=default, user.id=54c3d35f7ad34e87bf733354f4b0f781) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:43.592079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2adeb-0677-4083-ba8d-6a7eb3ec3456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:43.593750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2adeb-0677-4083-ba8d-6a7eb3ec3456 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:43.599682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 31/56] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Aug 10 11:03:43 2022] GET /identity/v3/role_assignments?user.id=54c3d35f7ad34e87bf733354f4b0f781&scope.domain.id=default&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:43.655877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 26/57] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Aug 10 11:03:43 2022] POST /identity/v3/projects => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:03:45.654854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95e19-14bb-4960-a5d2-381aee663730 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:45.655373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95e19-14bb-4960-a5d2-381aee663730 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:45.655488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb95e19-14bb-4960-a5d2-381aee663730 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:45.656764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 32/58] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:45.662159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbcea2-768b-4c50-a1ca-803454b05a41 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:45.662571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbcea2-768b-4c50-a1ca-803454b05a41 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:45.662723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbcea2-768b-4c50-a1ca-803454b05a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:45.680776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5afbcea2-768b-4c50-a1ca-803454b05a41 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:45.681981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5afbcea2-768b-4c50-a1ca-803454b05a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:45.746591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 27/59] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:45.770926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb95e19-14bb-4960-a5d2-381aee663730 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:45.868302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb95e19-14bb-4960-a5d2-381aee663730 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:45.901563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d578def-8eed-429c-8496-aa8386275ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:45.902185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578def-8eed-429c-8496-aa8386275ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:45.902465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578def-8eed-429c-8496-aa8386275ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:45.902736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578def-8eed-429c-8496-aa8386275ea8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:45.903817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d578def-8eed-429c-8496-aa8386275ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:45.906082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d578def-8eed-429c-8496-aa8386275ea8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:45.907568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 33/60] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:45.913423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbcea2-768b-4c50-a1ca-803454b05a41 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:46.001979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:46.008207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbcea2-768b-4c50-a1ca-803454b05a41 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:46.041266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0d1d6-cb2a-494d-ad2a-5457f7b729d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:46.041872 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d1d6-cb2a-494d-ad2a-5457f7b729d7 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:46.042150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d1d6-cb2a-494d-ad2a-5457f7b729d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:46.042423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d1d6-cb2a-494d-ad2a-5457f7b729d7 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:46.043067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0d1d6-cb2a-494d-ad2a-5457f7b729d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:46.044580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0d1d6-cb2a-494d-ad2a-5457f7b729d7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:46.149421 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 28/61] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:03:45 2022] POST /identity/v3/users => generated 275 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:03:49.284359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2145-ea8a-4c87-a799-8b49a310cbfd None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.285212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2145-ea8a-4c87-a799-8b49a310cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.285636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de2145-ea8a-4c87-a799-8b49a310cbfd None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.287152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 34/62] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:49.292464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa543b-b01d-4701-bac5-9a312c45e967 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.293272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa543b-b01d-4701-bac5-9a312c45e967 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.293770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa543b-b01d-4701-bac5-9a312c45e967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.326779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-18fa543b-b01d-4701-bac5-9a312c45e967 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:49.328517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-18fa543b-b01d-4701-bac5-9a312c45e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:49.364958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28045f-341a-4b39-8465-101ece6faea8 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.365553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28045f-341a-4b39-8465-101ece6faea8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.366041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28045f-341a-4b39-8465-101ece6faea8 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.367596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 35/63] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:03:49.373362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92762d62-0e73-412b-b21f-1b0973507d01 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.374260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92762d62-0e73-412b-b21f-1b0973507d01 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.374749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92762d62-0e73-412b-b21f-1b0973507d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.400514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-92762d62-0e73-412b-b21f-1b0973507d01 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:49.402066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-92762d62-0e73-412b-b21f-1b0973507d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:49.435822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 29/64] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:49.452711 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:49.483789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80a8c-4bd2-4e33-ada0-4cd1b496cb87 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.484096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80a8c-4bd2-4e33-ada0-4cd1b496cb87 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.484374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80a8c-4bd2-4e33-ada0-4cd1b496cb87 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.485976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 30/65] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:49.487560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d80a8c-4bd2-4e33-ada0-4cd1b496cb87 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:49.509693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 36/66] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:03:49.511655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b770-78d8-4add-a1ad-aa3e09260605 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.511944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b770-78d8-4add-a1ad-aa3e09260605 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.512222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b770-78d8-4add-a1ad-aa3e09260605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.544403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2230b770-78d8-4add-a1ad-aa3e09260605 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:49.545832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2230b770-78d8-4add-a1ad-aa3e09260605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:49.592986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:49.618209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 37/67] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:49.619419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b770-78d8-4add-a1ad-aa3e09260605 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:49.627829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d80a8c-4bd2-4e33-ada0-4cd1b496cb87 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:49.680639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfb52f-a6c9-40af-bd42-f278e8133227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:49.682053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfb52f-a6c9-40af-bd42-f278e8133227 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.682574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfb52f-a6c9-40af-bd42-f278e8133227 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.682988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfb52f-a6c9-40af-bd42-f278e8133227 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.698216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfb52f-a6c9-40af-bd42-f278e8133227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-41dfb52f-a6c9-40af-bd42-f278e8133227 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:49.704833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:49.705852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:49.706777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:03:49.709891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 31/68] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:49.710820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfb52f-a6c9-40af-bd42-f278e8133227 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:49.733369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:49.749164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b770-78d8-4add-a1ad-aa3e09260605 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:49.787140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592a1a6-a5f7-45a0-8161-13c9d0859c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:49.788269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592a1a6-a5f7-45a0-8161-13c9d0859c0f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.788634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592a1a6-a5f7-45a0-8161-13c9d0859c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.789049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592a1a6-a5f7-45a0-8161-13c9d0859c0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.800905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592a1a6-a5f7-45a0-8161-13c9d0859c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-b592a1a6-a5f7-45a0-8161-13c9d0859c0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:49.806128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:49.807141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:03:49.808076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:03:49.810053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 38/69] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:03:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:49.814734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592a1a6-a5f7-45a0-8161-13c9d0859c0f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:49.833031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfb52f-a6c9-40af-bd42-f278e8133227 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:49.869357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8c22d-d414-47ee-863d-9221c1b1de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:49.869998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8c22d-d414-47ee-863d-9221c1b1de5f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.870280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8c22d-d414-47ee-863d-9221c1b1de5f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.870714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8c22d-d414-47ee-863d-9221c1b1de5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.878681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:49.881648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8c22d-d414-47ee-863d-9221c1b1de5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cfc8c22d-d414-47ee-863d-9221c1b1de5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:49.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:49.893415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 32/70] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:49.894202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb4d42-1b0e-40e0-b239-c873eb6ecd8d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.897803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb4d42-1b0e-40e0-b239-c873eb6ecd8d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.897803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb4d42-1b0e-40e0-b239-c873eb6ecd8d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.897803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 33/71] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:49.897803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb4d42-1b0e-40e0-b239-c873eb6ecd8d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:49.931886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592a1a6-a5f7-45a0-8161-13c9d0859c0f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:49.968136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c0a99-5b10-4362-9bee-6a51cead8a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:49.968880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c0a99-5b10-4362-9bee-6a51cead8a53 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.969136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c0a99-5b10-4362-9bee-6a51cead8a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.969488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c0a99-5b10-4362-9bee-6a51cead8a53 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:49.970075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c0a99-5b10-4362-9bee-6a51cead8a53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:49.970376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c0a99-5b10-4362-9bee-6a51cead8a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:49.971986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c0a99-5b10-4362-9bee-6a51cead8a53 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:49.984412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 39/72] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:03:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:49.984412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aceee4-5b56-4d1f-a4de-e6a633992f0a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:49.984412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aceee4-5b56-4d1f-a4de-e6a633992f0a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:49.984856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aceee4-5b56-4d1f-a4de-e6a633992f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.002893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e9aceee4-5b56-4d1f-a4de-e6a633992f0a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:50.004072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e9aceee4-5b56-4d1f-a4de-e6a633992f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:50.006901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.012917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb4d42-1b0e-40e0-b239-c873eb6ecd8d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.049013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.049727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.050010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.050281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.051007 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:50.051257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.052662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.060529 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 34/73] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:03:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:50.061211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.072167 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 40/74] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:50.073131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aceee4-5b56-4d1f-a4de-e6a633992f0a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.135264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.171348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aceee4-5b56-4d1f-a4de-e6a633992f0a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.173824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5bd1d-b70e-4a70-94a8-a2a02783bd60 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.206603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cf4ff-7386-40ed-9e5c-b6b2e0d1ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.207238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cf4ff-7386-40ed-9e5c-b6b2e0d1ba63 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.207382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2869f1-a693-4a81-9dc1-61dea2fad634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.207521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cf4ff-7386-40ed-9e5c-b6b2e0d1ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.207779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cf4ff-7386-40ed-9e5c-b6b2e0d1ba63 None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.207991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2869f1-a693-4a81-9dc1-61dea2fad634 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.208271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2869f1-a693-4a81-9dc1-61dea2fad634 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.208576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2869f1-a693-4a81-9dc1-61dea2fad634 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.209238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2869f1-a693-4a81-9dc1-61dea2fad634 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:50.209544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2869f1-a693-4a81-9dc1-61dea2fad634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.210889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2869f1-a693-4a81-9dc1-61dea2fad634 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.218383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.219709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 35/75] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:50.220638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96ab2-22ad-4393-afd4-2cac37cdd302 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.220922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96ab2-22ad-4393-afd4-2cac37cdd302 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.221196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96ab2-22ad-4393-afd4-2cac37cdd302 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.222235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cf4ff-7386-40ed-9e5c-b6b2e0d1ba63 None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.222381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 36/76] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:50.226307 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d96ab2-22ad-4393-afd4-2cac37cdd302 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.228282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cf4ff-7386-40ed-9e5c-b6b2e0d1ba63 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.234029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 41/77] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:50.234029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cf4ff-7386-40ed-9e5c-b6b2e0d1ba63 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.321899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d96ab2-22ad-4393-afd4-2cac37cdd302 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.330282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cf4ff-7386-40ed-9e5c-b6b2e0d1ba63 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.345134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.355506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5064cb-9758-45fd-a243-dfdd6f5e2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.356145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5064cb-9758-45fd-a243-dfdd6f5e2499 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.356528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5064cb-9758-45fd-a243-dfdd6f5e2499 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.356809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5064cb-9758-45fd-a243-dfdd6f5e2499 None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.358378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5064cb-9758-45fd-a243-dfdd6f5e2499 None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.359813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5064cb-9758-45fd-a243-dfdd6f5e2499 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.361423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 37/78] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:50.366147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5064cb-9758-45fd-a243-dfdd6f5e2499 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.369202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aee20-5314-496a-b3d2-3435de6a4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.369912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aee20-5314-496a-b3d2-3435de6a4212 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.370196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aee20-5314-496a-b3d2-3435de6a4212 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.370467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aee20-5314-496a-b3d2-3435de6a4212 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.380666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aee20-5314-496a-b3d2-3435de6a4212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-465aee20-5314-496a-b3d2-3435de6a4212 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:50.385303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:50.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:50.387131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:03:50.391312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 42/79] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:50.392929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e32e9-115e-4828-8b6b-552253652fb7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.393222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e32e9-115e-4828-8b6b-552253652fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.393503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e32e9-115e-4828-8b6b-552253652fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.411833 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a55e32e9-115e-4828-8b6b-552253652fb7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:50.413052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a55e32e9-115e-4828-8b6b-552253652fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:50.463132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.465652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5064cb-9758-45fd-a243-dfdd6f5e2499 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.477359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 43/80] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:50.478340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e32e9-115e-4828-8b6b-552253652fb7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.514470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223913-8072-4d51-8203-7a9587c68160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.515164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223913-8072-4d51-8203-7a9587c68160 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.515445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223913-8072-4d51-8203-7a9587c68160 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.515717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223913-8072-4d51-8203-7a9587c68160 None admin] PATH_INFO: `/v3/users/54c3d35f7ad34e87bf733354f4b0f781` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.516880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223913-8072-4d51-8203-7a9587c68160 None admin] RBAC: Authorizing `identity:get_user(user_id=54c3d35f7ad34e87bf733354f4b0f781)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.518362 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223913-8072-4d51-8203-7a9587c68160 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.519929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 38/81] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/users/54c3d35f7ad34e87bf733354f4b0f781 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:50.520793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223913-8072-4d51-8203-7a9587c68160 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.578505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.581391 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e32e9-115e-4828-8b6b-552253652fb7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.613740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42550738-6410-4ce0-acc4-2a898870c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.614351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42550738-6410-4ce0-acc4-2a898870c25e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.614655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42550738-6410-4ce0-acc4-2a898870c25e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.614929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42550738-6410-4ce0-acc4-2a898870c25e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.617864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223913-8072-4d51-8203-7a9587c68160 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.651552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a23be-f420-44ff-a228-6c5f200d1d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.652154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a23be-f420-44ff-a228-6c5f200d1d6a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.652468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a23be-f420-44ff-a228-6c5f200d1d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.652744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a23be-f420-44ff-a228-6c5f200d1d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.668472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.680463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42550738-6410-4ce0-acc4-2a898870c25e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.682045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42550738-6410-4ce0-acc4-2a898870c25e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.719540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a23be-f420-44ff-a228-6c5f200d1d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.721028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a23be-f420-44ff-a228-6c5f200d1d6a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.775746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.777327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 44/82] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:03:50.778150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42550738-6410-4ce0-acc4-2a898870c25e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.816907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 39/83] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:03:50.817780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a23be-f420-44ff-a228-6c5f200d1d6a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.871650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:50.882936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42550738-6410-4ce0-acc4-2a898870c25e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.915842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.916169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a23be-f420-44ff-a228-6c5f200d1d6a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:50.916484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.916766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.917038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.917697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:50.917996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.919362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.927988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 45/84] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:50.928792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.949667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249178f-6e8d-4dec-85bc-56557c86614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:50.950301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249178f-6e8d-4dec-85bc-56557c86614a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:50.950582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249178f-6e8d-4dec-85bc-56557c86614a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:50.951380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249178f-6e8d-4dec-85bc-56557c86614a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:50.952508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249178f-6e8d-4dec-85bc-56557c86614a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:50.953944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249178f-6e8d-4dec-85bc-56557c86614a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:50.955488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 40/85] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:50.956237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249178f-6e8d-4dec-85bc-56557c86614a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:50.985130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.027179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44196-c119-4536-b5b5-9db38f52315a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.054880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249178f-6e8d-4dec-85bc-56557c86614a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.060336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5900e-ba22-4c07-85fd-d059a3004102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.060949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5900e-ba22-4c07-85fd-d059a3004102 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.061265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5900e-ba22-4c07-85fd-d059a3004102 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.061546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5900e-ba22-4c07-85fd-d059a3004102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.080478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.088239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3296d-3548-4bc0-963f-fb85745c3564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.092675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3296d-3548-4bc0-963f-fb85745c3564 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.092675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3296d-3548-4bc0-963f-fb85745c3564 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.092675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3296d-3548-4bc0-963f-fb85745c3564 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.092675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3296d-3548-4bc0-963f-fb85745c3564 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.092675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3296d-3548-4bc0-963f-fb85745c3564 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.094143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 41/86] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:51.094904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3296d-3548-4bc0-963f-fb85745c3564 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.130912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5900e-ba22-4c07-85fd-d059a3004102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.132423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5900e-ba22-4c07-85fd-d059a3004102 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.186848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.192938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3296d-3548-4bc0-963f-fb85745c3564 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.227011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac516b2a-8354-45c3-bf83-21642a33d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.227896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516b2a-8354-45c3-bf83-21642a33d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.228000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 46/87] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:03:51.228097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516b2a-8354-45c3-bf83-21642a33d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.228263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516b2a-8354-45c3-bf83-21642a33d6e4 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.228587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5900e-ba22-4c07-85fd-d059a3004102 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.233139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac516b2a-8354-45c3-bf83-21642a33d6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.234564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac516b2a-8354-45c3-bf83-21642a33d6e4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.236191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 42/88] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:51 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:51.237632 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac516b2a-8354-45c3-bf83-21642a33d6e4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.276937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.325574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5900e-ba22-4c07-85fd-d059a3004102 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.337426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac516b2a-8354-45c3-bf83-21642a33d6e4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.358239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a06ad-337f-4e12-b5ab-38c65707561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.358873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a06ad-337f-4e12-b5ab-38c65707561d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.359154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a06ad-337f-4e12-b5ab-38c65707561d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.359435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a06ad-337f-4e12-b5ab-38c65707561d None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.360599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a06ad-337f-4e12-b5ab-38c65707561d None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.362069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a06ad-337f-4e12-b5ab-38c65707561d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.363632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 47/89] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:51 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:51.364418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a06ad-337f-4e12-b5ab-38c65707561d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.371194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40718676-2242-471a-ae7c-5022971f6295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.371805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40718676-2242-471a-ae7c-5022971f6295 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.372085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40718676-2242-471a-ae7c-5022971f6295 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.372391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40718676-2242-471a-ae7c-5022971f6295 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.373787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40718676-2242-471a-ae7c-5022971f6295 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.375216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40718676-2242-471a-ae7c-5022971f6295 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.453205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 43/90] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:03:51 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:03:51.454062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40718676-2242-471a-ae7c-5022971f6295 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.472058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a06ad-337f-4e12-b5ab-38c65707561d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.478115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.494777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.515790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.516461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.516744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.517019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.517878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] RBAC: Adding query filter params (role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4, user.id=5c85fe8a38f6491ebff4972f42b84145) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:51.518195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.519725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.536359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 48/91] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:03:51 2022] GET /identity/v3/role_assignments?user.id=5c85fe8a38f6491ebff4972f42b84145&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:51.536359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.582416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40718676-2242-471a-ae7c-5022971f6295 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.634552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769acf-178d-488d-98b1-869a4d5441c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.635355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769acf-178d-488d-98b1-869a4d5441c5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.635700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769acf-178d-488d-98b1-869a4d5441c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.636048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769acf-178d-488d-98b1-869a4d5441c5 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.637414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd769acf-178d-488d-98b1-869a4d5441c5 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.639659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd769acf-178d-488d-98b1-869a4d5441c5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.641521 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 44/92] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:51 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:51.642333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769acf-178d-488d-98b1-869a4d5441c5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.681465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18b1be-7fab-47c6-9c95-472d35de6f21 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.726298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.726849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.727414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.727700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.728652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] RBAC: Adding query filter params (role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4, user.id=5c85fe8a38f6491ebff4972f42b84145) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:51.728977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.731286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.741313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 49/93] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:03:51 2022] GET /identity/v3/role_assignments?user.id=5c85fe8a38f6491ebff4972f42b84145&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:51.745176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:51.758366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.774173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769acf-178d-488d-98b1-869a4d5441c5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.831614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752516c-bf38-4df0-bc83-e42cee6a281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.832243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752516c-bf38-4df0-bc83-e42cee6a281b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.832547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752516c-bf38-4df0-bc83-e42cee6a281b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.832821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752516c-bf38-4df0-bc83-e42cee6a281b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.834043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:51.909555 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60849d-57fd-486b-ab3f-e87694f4ae2c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:51.954797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:51.955423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:51.955705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:51.955980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:51.957023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4, user.id=54c3d35f7ad34e87bf733354f4b0f781) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:51.957335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.958006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752516c-bf38-4df0-bc83-e42cee6a281b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:51.958792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.959979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752516c-bf38-4df0-bc83-e42cee6a281b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:51.969531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 50/94] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:03:51 2022] GET /identity/v3/role_assignments?user.id=54c3d35f7ad34e87bf733354f4b0f781&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:52.071434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:52.089044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 45/95] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:03:52.095168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:52.220423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f9c7d-2d6e-4810-a118-9e1fea3fa824 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:52.231665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:52.256526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64f64-8dee-488e-8a18-af0e2d1e1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:52.257165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64f64-8dee-488e-8a18-af0e2d1e1815 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:52.257445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64f64-8dee-488e-8a18-af0e2d1e1815 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:52.257720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64f64-8dee-488e-8a18-af0e2d1e1815 None admin] PATH_INFO: `/v3/projects/63202f1968a64d16936ada4895d02654` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:52.258887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64f64-8dee-488e-8a18-af0e2d1e1815 None admin] RBAC: Authorizing `identity:get_project(project_id=63202f1968a64d16936ada4895d02654)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:52.260351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64f64-8dee-488e-8a18-af0e2d1e1815 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:52.262039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 51/96] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:52 2022] GET /identity/v3/projects/63202f1968a64d16936ada4895d02654 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:52.268650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752516c-bf38-4df0-bc83-e42cee6a281b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:52.375710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752516c-bf38-4df0-bc83-e42cee6a281b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:52.412656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd9591-f086-4cd3-9682-e4b72f2044bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:52.413279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9591-f086-4cd3-9682-e4b72f2044bc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:52.413555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9591-f086-4cd3-9682-e4b72f2044bc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:52.413831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9591-f086-4cd3-9682-e4b72f2044bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:52.414567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd9591-f086-4cd3-9682-e4b72f2044bc None admin] RBAC: Adding query filter params (role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=63202f1968a64d16936ada4895d02654, user.id=5c85fe8a38f6491ebff4972f42b84145) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:52.414870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd9591-f086-4cd3-9682-e4b72f2044bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:52.416375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd9591-f086-4cd3-9682-e4b72f2044bc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:52.425885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 46/97] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:03:52 2022] GET /identity/v3/role_assignments?user.id=5c85fe8a38f6491ebff4972f42b84145&scope.project.id=63202f1968a64d16936ada4895d02654&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:54.050515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4c1f0-71bd-4e8d-964d-af4e5ff0bc99 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.051023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4c1f0-71bd-4e8d-964d-af4e5ff0bc99 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.051129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4c1f0-71bd-4e8d-964d-af4e5ff0bc99 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.052420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 52/98] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:54.057568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350025-f5ba-4425-abe5-a381c3aacce0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.057959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350025-f5ba-4425-abe5-a381c3aacce0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.058122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350025-f5ba-4425-abe5-a381c3aacce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.085465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4a350025-f5ba-4425-abe5-a381c3aacce0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:54.086646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4a350025-f5ba-4425-abe5-a381c3aacce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:54.144574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:54.168837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 47/99] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:54.201323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4c1f0-71bd-4e8d-964d-af4e5ff0bc99 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:54.335629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4c1f0-71bd-4e8d-964d-af4e5ff0bc99 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:54.374867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d95afe-cc32-4ad8-9d3d-85d1d1ef0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:54.375500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d95afe-cc32-4ad8-9d3d-85d1d1ef0e45 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.375779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d95afe-cc32-4ad8-9d3d-85d1d1ef0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.376051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d95afe-cc32-4ad8-9d3d-85d1d1ef0e45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.390858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d95afe-cc32-4ad8-9d3d-85d1d1ef0e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:54.395148 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930033-bdd1-44f5-afe9-5142e1997fb0 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.395444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930033-bdd1-44f5-afe9-5142e1997fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-50d95afe-cc32-4ad8-9d3d-85d1d1ef0e45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:54.395634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:54.396494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:54.397269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:03:54.397858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930033-bdd1-44f5-afe9-5142e1997fb0 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.397923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 53/100] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:54.397986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 48/101] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:54.402261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d95afe-cc32-4ad8-9d3d-85d1d1ef0e45 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:54.416766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29352-da97-4104-8309-0410899e8ab8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.417048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29352-da97-4104-8309-0410899e8ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.417328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29352-da97-4104-8309-0410899e8ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.445961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-07c29352-da97-4104-8309-0410899e8ab8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:54.447146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-07c29352-da97-4104-8309-0410899e8ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:54.480407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:54.566986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 49/102] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:03:54.570539 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d95afe-cc32-4ad8-9d3d-85d1d1ef0e45 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:54.601938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29352-da97-4104-8309-0410899e8ab8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:54.626742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:54.627357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.627637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.628093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.629745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:54.630050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:54.631432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:54.647736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 54/103] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:03:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:54.654925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:54.779595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29352-da97-4104-8309-0410899e8ab8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:54.799466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:54.807334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cdd70-4ef6-45b6-b97d-0aaa497dac26 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:54.828332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:54.864413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919336d9-42b1-4be7-a40c-a3c90a7430a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:54.864413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919336d9-42b1-4be7-a40c-a3c90a7430a1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.864413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919336d9-42b1-4be7-a40c-a3c90a7430a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.864413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919336d9-42b1-4be7-a40c-a3c90a7430a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.864749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919336d9-42b1-4be7-a40c-a3c90a7430a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:54.866717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919336d9-42b1-4be7-a40c-a3c90a7430a1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:54.868339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 50/104] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:54.875645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919336d9-42b1-4be7-a40c-a3c90a7430a1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:54.965044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e8b6-ab41-4d54-bef6-d30456b16a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:54.965708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e8b6-ab41-4d54-bef6-d30456b16a7a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:54.965997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e8b6-ab41-4d54-bef6-d30456b16a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:54.966310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e8b6-ab41-4d54-bef6-d30456b16a7a None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:54.973050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379e8b6-ab41-4d54-bef6-d30456b16a7a None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:54.974532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379e8b6-ab41-4d54-bef6-d30456b16a7a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:54.976157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 55/105] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:54 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:54.985266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e8b6-ab41-4d54-bef6-d30456b16a7a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:55.019052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919336d9-42b1-4be7-a40c-a3c90a7430a1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:55.057592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f50d61-12e4-48fa-ad67-9a7120b88876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:55.058268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50d61-12e4-48fa-ad67-9a7120b88876 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.058554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50d61-12e4-48fa-ad67-9a7120b88876 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.058831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50d61-12e4-48fa-ad67-9a7120b88876 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.061354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f50d61-12e4-48fa-ad67-9a7120b88876 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:55.062384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f50d61-12e4-48fa-ad67-9a7120b88876 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:55.168628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 51/106] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:03:54 2022] POST /identity/v3/projects => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:03:55.170050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34473501-9d86-46df-98ed-1a2651353126 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.170186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e8b6-ab41-4d54-bef6-d30456b16a7a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:55.170599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34473501-9d86-46df-98ed-1a2651353126 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.170599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34473501-9d86-46df-98ed-1a2651353126 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.173146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 52/107] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:55.174359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c03a-1a72-41da-a940-8e9f362fd667 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.174649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c03a-1a72-41da-a940-8e9f362fd667 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.174927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c03a-1a72-41da-a940-8e9f362fd667 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.176478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 53/108] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:55.178087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4cf5-3fc9-4a49-bc5a-d911612435be None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.178374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4cf5-3fc9-4a49-bc5a-d911612435be None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.178652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c4cf5-3fc9-4a49-bc5a-d911612435be None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.179968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 54/109] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:55.186138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d524a-3a9f-48df-9ecd-3b6fcb19d557 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.186423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d524a-3a9f-48df-9ecd-3b6fcb19d557 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.186707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d524a-3a9f-48df-9ecd-3b6fcb19d557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.206329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1a6d524a-3a9f-48df-9ecd-3b6fcb19d557 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:55.207555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a6d524a-3a9f-48df-9ecd-3b6fcb19d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:55.213885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933cce0-82c2-4f90-ad5a-27b3019f5c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:55.214817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933cce0-82c2-4f90-ad5a-27b3019f5c34 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.215246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933cce0-82c2-4f90-ad5a-27b3019f5c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.215693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933cce0-82c2-4f90-ad5a-27b3019f5c34 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.217426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933cce0-82c2-4f90-ad5a-27b3019f5c34 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:55.219257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933cce0-82c2-4f90-ad5a-27b3019f5c34 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:55.221342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 56/110] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:54 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:55.222994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6007d9-e2e4-46bf-b944-9020be76a586 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.223592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6007d9-e2e4-46bf-b944-9020be76a586 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.224272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6007d9-e2e4-46bf-b944-9020be76a586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.239266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:55.244088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-1a6007d9-e2e4-46bf-b944-9020be76a586 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:55.245321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1a6007d9-e2e4-46bf-b944-9020be76a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:55.279190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:55.305542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 55/111] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:55.307410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870c979-ddaa-45f4-808a-253c73a61539 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.307909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870c979-ddaa-45f4-808a-253c73a61539 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.309112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870c979-ddaa-45f4-808a-253c73a61539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.324636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 57/112] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:55.324636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6007d9-e2e4-46bf-b944-9020be76a586 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:55.346600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1870c979-ddaa-45f4-808a-253c73a61539 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:55.348179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1870c979-ddaa-45f4-808a-253c73a61539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:55.454733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 56/113] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:55.455512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870c979-ddaa-45f4-808a-253c73a61539 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:55.468058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6007d9-e2e4-46bf-b944-9020be76a586 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:55.507042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b80bc-9733-48f0-8c28-69b8cc7ca8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:55.507830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b80bc-9733-48f0-8c28-69b8cc7ca8e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.508300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b80bc-9733-48f0-8c28-69b8cc7ca8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.508671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b80bc-9733-48f0-8c28-69b8cc7ca8e9 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/users/5c85fe8a38f6491ebff4972f42b84145/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.510759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b80bc-9733-48f0-8c28-69b8cc7ca8e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=299bafe38f4d4f39a7408242bcc8e7a4, user_id=5c85fe8a38f6491ebff4972f42b84145, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:55.512487 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b80bc-9733-48f0-8c28-69b8cc7ca8e9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:55.559128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:55.568640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870c979-ddaa-45f4-808a-253c73a61539 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:55.586988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 58/114] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:03:55 2022] PUT /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/users/5c85fe8a38f6491ebff4972f42b84145/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:03:55.593859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b80bc-9733-48f0-8c28-69b8cc7ca8e9 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:55.626777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a7e91-52f2-4c0a-a85d-e2b097909c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:55.629554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a7e91-52f2-4c0a-a85d-e2b097909c0a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.629959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a7e91-52f2-4c0a-a85d-e2b097909c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.630242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a7e91-52f2-4c0a-a85d-e2b097909c0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.653518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:55.669017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a7e91-52f2-4c0a-a85d-e2b097909c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ba5a7e91-52f2-4c0a-a85d-e2b097909c0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:55.679985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:55.680944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:03:55.681714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 57/115] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:55.682332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a7e91-52f2-4c0a-a85d-e2b097909c0a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:55.775645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b80bc-9733-48f0-8c28-69b8cc7ca8e9 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:55.812518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a7e91-52f2-4c0a-a85d-e2b097909c0a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:55.829562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cdd78-bb19-4469-8bb0-e399d1f6075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:55.830269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdd78-bb19-4469-8bb0-e399d1f6075b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.830561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdd78-bb19-4469-8bb0-e399d1f6075b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.830836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdd78-bb19-4469-8bb0-e399d1f6075b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.842695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cdd78-bb19-4469-8bb0-e399d1f6075b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-b23cdd78-bb19-4469-8bb0-e399d1f6075b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:55.847448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:55.848484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 59/116] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:03:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:55.849358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cdd78-bb19-4469-8bb0-e399d1f6075b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:55.866117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce642-0f20-4474-9af9-0bfc94aef12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:55.867249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce642-0f20-4474-9af9-0bfc94aef12a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.867797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce642-0f20-4474-9af9-0bfc94aef12a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.868078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce642-0f20-4474-9af9-0bfc94aef12a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.883689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bce642-0f20-4474-9af9-0bfc94aef12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c7bce642-0f20-4474-9af9-0bfc94aef12a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:55.889926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:55.890786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:03:55.891549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:03:55.892128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 58/117] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:55.893286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc354cf7-1bdb-4a70-8a7d-485c79ecd2f6 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:55.893580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc354cf7-1bdb-4a70-8a7d-485c79ecd2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:55.893862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc354cf7-1bdb-4a70-8a7d-485c79ecd2f6 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:55.896391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 59/118] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:55.897152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc354cf7-1bdb-4a70-8a7d-485c79ecd2f6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:55.923530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:55.945573 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:55.961952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cdd78-bb19-4469-8bb0-e399d1f6075b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.002035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.002758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.003091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.003369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.004045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:56.004475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.006169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.020581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 60/119] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:03:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:56.021653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.032099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc354cf7-1bdb-4a70-8a7d-485c79ecd2f6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.084734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d6973-0d73-4f1a-8766-1fb4d316b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.085426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d6973-0d73-4f1a-8766-1fb4d316b392 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.085666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d6973-0d73-4f1a-8766-1fb4d316b392 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.085945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d6973-0d73-4f1a-8766-1fb4d316b392 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.086630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d6973-0d73-4f1a-8766-1fb4d316b392 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:56.086937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d6973-0d73-4f1a-8766-1fb4d316b392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.088900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d6973-0d73-4f1a-8766-1fb4d316b392 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.102236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 60/120] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:03:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:56.104386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e326-8687-42ed-9c23-fd158e12f9f2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.104683 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e326-8687-42ed-9c23-fd158e12f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.105041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e326-8687-42ed-9c23-fd158e12f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.130089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-71f7e326-8687-42ed-9c23-fd158e12f9f2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:56.131994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-71f7e326-8687-42ed-9c23-fd158e12f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:56.141433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b51df-3b31-4618-bf66-ca8f24267013 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.179557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.180348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.180679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.181026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.181796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:56.182330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.184633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.195022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 61/121] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:56.196401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.213571 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:56.228396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 61/122] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:56.229431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7e326-8687-42ed-9c23-fd158e12f9f2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.237541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:56.324064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c504f-cfd4-49e9-a07f-f997f8231c2b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.358262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7e326-8687-42ed-9c23-fd158e12f9f2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.362228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a7ac2-5e52-46fe-b4c4-278159673b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.362873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a7ac2-5e52-46fe-b4c4-278159673b38 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.363159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a7ac2-5e52-46fe-b4c4-278159673b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.363512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a7ac2-5e52-46fe-b4c4-278159673b38 None admin] PATH_INFO: `/v3/users/43c70349555f4da0af8dbb54f227c1ab` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.378246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a7ac2-5e52-46fe-b4c4-278159673b38 None admin] RBAC: Authorizing `identity:get_user(user_id=43c70349555f4da0af8dbb54f227c1ab)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.379699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a7ac2-5e52-46fe-b4c4-278159673b38 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.381474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 62/123] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/users/43c70349555f4da0af8dbb54f227c1ab => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:56.382375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a7ac2-5e52-46fe-b4c4-278159673b38 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.396814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238733-bada-451f-97b9-8c0918d33920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.397572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238733-bada-451f-97b9-8c0918d33920 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.397855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238733-bada-451f-97b9-8c0918d33920 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.398135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238733-bada-451f-97b9-8c0918d33920 None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.399341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53238733-bada-451f-97b9-8c0918d33920 None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.400841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53238733-bada-451f-97b9-8c0918d33920 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.402517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 62/124] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:56.403429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238733-bada-451f-97b9-8c0918d33920 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.459041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:56.478466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:56.496123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a7ac2-5e52-46fe-b4c4-278159673b38 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.510525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238733-bada-451f-97b9-8c0918d33920 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.535059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb45dc-3eed-476b-8aab-d30963b0823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.536025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb45dc-3eed-476b-8aab-d30963b0823a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.536640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb45dc-3eed-476b-8aab-d30963b0823a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.536929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb45dc-3eed-476b-8aab-d30963b0823a None admin] PATH_INFO: `/v3/users/54c3d35f7ad34e87bf733354f4b0f781` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.538509 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb45dc-3eed-476b-8aab-d30963b0823a None admin] RBAC: Authorizing `identity:get_user(user_id=54c3d35f7ad34e87bf733354f4b0f781)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.540238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb45dc-3eed-476b-8aab-d30963b0823a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.543050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 63/125] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/users/54c3d35f7ad34e87bf733354f4b0f781 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:56.543881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb45dc-3eed-476b-8aab-d30963b0823a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.546546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde387-bb28-4139-8d0d-820f92a492ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.547195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde387-bb28-4139-8d0d-820f92a492ee None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.547703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde387-bb28-4139-8d0d-820f92a492ee None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.547869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde387-bb28-4139-8d0d-820f92a492ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.566554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde387-bb28-4139-8d0d-820f92a492ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-93cde387-bb28-4139-8d0d-820f92a492ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:56.573377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:56.575443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 63/126] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:03:56.578192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde387-bb28-4139-8d0d-820f92a492ee None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.665993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb45dc-3eed-476b-8aab-d30963b0823a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.706295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4147-840a-4e48-911d-0f11aae2599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.707256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4147-840a-4e48-911d-0f11aae2599e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.707635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4147-840a-4e48-911d-0f11aae2599e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.708297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4147-840a-4e48-911d-0f11aae2599e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.712936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:56.717419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde387-bb28-4139-8d0d-820f92a492ee None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.759021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:56.766114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2e864-5316-4ce8-9f0d-d72107dfd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.766756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2e864-5316-4ce8-9f0d-d72107dfd068 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.767042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2e864-5316-4ce8-9f0d-d72107dfd068 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.767319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2e864-5316-4ce8-9f0d-d72107dfd068 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.768981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2e864-5316-4ce8-9f0d-d72107dfd068 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.770959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2e864-5316-4ce8-9f0d-d72107dfd068 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.773392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 64/127] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:56.774163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2e864-5316-4ce8-9f0d-d72107dfd068 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.787462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e4147-840a-4e48-911d-0f11aae2599e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.789209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e4147-840a-4e48-911d-0f11aae2599e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.902323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 64/128] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:03:56.903377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4147-840a-4e48-911d-0f11aae2599e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:56.911925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2e864-5316-4ce8-9f0d-d72107dfd068 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:56.948448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e039b-63ca-4211-83fc-2cdddd30a482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:56.949191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e039b-63ca-4211-83fc-2cdddd30a482 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:56.949584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e039b-63ca-4211-83fc-2cdddd30a482 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:56.949937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e039b-63ca-4211-83fc-2cdddd30a482 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:56.951719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e039b-63ca-4211-83fc-2cdddd30a482 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:56.953284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e039b-63ca-4211-83fc-2cdddd30a482 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:56.955235 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 65/129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:56.955420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:56.956038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e039b-63ca-4211-83fc-2cdddd30a482 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:57.026375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:57.034016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4147-840a-4e48-911d-0f11aae2599e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.064135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e039b-63ca-4211-83fc-2cdddd30a482 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.077652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.078277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.078563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.078840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.079679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:57.079986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.082090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:57.093035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 65/130] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:03:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:57.093868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:57.107359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9cd03-2a45-4e94-89de-a1fcbb0e596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.108220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9cd03-2a45-4e94-89de-a1fcbb0e596b None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.108610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9cd03-2a45-4e94-89de-a1fcbb0e596b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.108961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9cd03-2a45-4e94-89de-a1fcbb0e596b None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/users/5c85fe8a38f6491ebff4972f42b84145/roles/1b09a9c0489848ada69cb56ccf36aebd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.111316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9cd03-2a45-4e94-89de-a1fcbb0e596b None admin] RBAC: Authorizing `identity:create_grant(project_id=299bafe38f4d4f39a7408242bcc8e7a4, user_id=5c85fe8a38f6491ebff4972f42b84145, role_id=1b09a9c0489848ada69cb56ccf36aebd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.112875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9cd03-2a45-4e94-89de-a1fcbb0e596b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:57.203717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:57.205460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 66/131] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:03:56 2022] PUT /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/users/5c85fe8a38f6491ebff4972f42b84145/roles/1b09a9c0489848ada69cb56ccf36aebd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:03:57.207017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9cd03-2a45-4e94-89de-a1fcbb0e596b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:57.218735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9fb09-7774-4bf9-9b7a-e92cebd64b69 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.292014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f9b0-5de6-46e6-b943-7efcdb1b3330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.292751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f9b0-5de6-46e6-b943-7efcdb1b3330 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.293036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f9b0-5de6-46e6-b943-7efcdb1b3330 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.293311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f9b0-5de6-46e6-b943-7efcdb1b3330 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.294717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77f9b0-5de6-46e6-b943-7efcdb1b3330 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.296744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77f9b0-5de6-46e6-b943-7efcdb1b3330 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:57.299907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 66/132] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:57 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:57.307161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f9b0-5de6-46e6-b943-7efcdb1b3330 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:57.429253 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9cd03-2a45-4e94-89de-a1fcbb0e596b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.457181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:57.459672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f9b0-5de6-46e6-b943-7efcdb1b3330 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.468627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fadbc-29fb-416a-ad41-603ad6e26f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.469545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fadbc-29fb-416a-ad41-603ad6e26f31 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.469988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fadbc-29fb-416a-ad41-603ad6e26f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.471564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fadbc-29fb-416a-ad41-603ad6e26f31 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/users/54c3d35f7ad34e87bf733354f4b0f781/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.473091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fadbc-29fb-416a-ad41-603ad6e26f31 None admin] RBAC: Authorizing `identity:create_grant(project_id=299bafe38f4d4f39a7408242bcc8e7a4, user_id=54c3d35f7ad34e87bf733354f4b0f781, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.474719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fadbc-29fb-416a-ad41-603ad6e26f31 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:57.496071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f41fa-fabb-41fa-8929-47b608dfed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.496736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f41fa-fabb-41fa-8929-47b608dfed5b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.497034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f41fa-fabb-41fa-8929-47b608dfed5b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.497622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f41fa-fabb-41fa-8929-47b608dfed5b None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.498771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f41fa-fabb-41fa-8929-47b608dfed5b None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.500204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f41fa-fabb-41fa-8929-47b608dfed5b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:57.501971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 67/133] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:57 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:57.505081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f41fa-fabb-41fa-8929-47b608dfed5b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:57.538057 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 67/134] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:03:57 2022] PUT /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/users/54c3d35f7ad34e87bf733354f4b0f781/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:03:57.539587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77f95e-060f-4b94-b098-9e7f19ef0e6b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.539881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77f95e-060f-4b94-b098-9e7f19ef0e6b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.540161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77f95e-060f-4b94-b098-9e7f19ef0e6b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.541610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 68/135] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:57.542184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77f95e-060f-4b94-b098-9e7f19ef0e6b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:57.562463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:57.654628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f41fa-fabb-41fa-8929-47b608dfed5b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.671280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77f95e-060f-4b94-b098-9e7f19ef0e6b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.710625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.711173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.711710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.711954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.715510 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] RBAC: Adding query filter params (role.id=d820a202bc2440d7b1f2a7190d4cae7c, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4, user.id=43c70349555f4da0af8dbb54f227c1ab) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:57.715844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.717386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02422e3-74a7-4727-92e8-0d8980c584de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.718048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02422e3-74a7-4727-92e8-0d8980c584de None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.718326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02422e3-74a7-4727-92e8-0d8980c584de None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.718599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02422e3-74a7-4727-92e8-0d8980c584de None admin] PATH_INFO: `/v3/projects/63202f1968a64d16936ada4895d02654` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.720053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:57.723117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02422e3-74a7-4727-92e8-0d8980c584de None admin] RBAC: Authorizing `identity:get_project(project_id=63202f1968a64d16936ada4895d02654)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.726838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02422e3-74a7-4727-92e8-0d8980c584de None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:57.730099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 69/136] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:57 2022] GET /identity/v3/projects/63202f1968a64d16936ada4895d02654 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:57.730872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 68/137] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:03:57 2022] GET /identity/v3/role_assignments?user.id=43c70349555f4da0af8dbb54f227c1ab&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=d820a202bc2440d7b1f2a7190d4cae7c => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:57.732547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75657-3b0e-44de-a59e-0db4eb5c038d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.732928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75657-3b0e-44de-a59e-0db4eb5c038d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.733322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75657-3b0e-44de-a59e-0db4eb5c038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.737909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:57.769970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-98d75657-3b0e-44de-a59e-0db4eb5c038d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:57.772195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-98d75657-3b0e-44de-a59e-0db4eb5c038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:57.882899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:57.900510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 70/138] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:57.901943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163402ff-1bd3-4333-9db9-797c05b881bc None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.902159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163402ff-1bd3-4333-9db9-797c05b881bc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.902417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163402ff-1bd3-4333-9db9-797c05b881bc None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.904241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 71/139] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:03:57.909869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe0dc8-7748-4c34-afc3-6d8fac9650ab None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:57.910353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c8f6-0c57-4a44-b7be-e5337f7c7b54 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.910647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c8f6-0c57-4a44-b7be-e5337f7c7b54 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.910926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4c8f6-0c57-4a44-b7be-e5337f7c7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.911870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:57.933816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f3f4c8f6-0c57-4a44-b7be-e5337f7c7b54 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:03:57.935561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f3f4c8f6-0c57-4a44-b7be-e5337f7c7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:03:57.963202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4a3a-2cd4-4574-8ce5-41ea6ad1ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:57.963805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4a3a-2cd4-4574-8ce5-41ea6ad1ad36 None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:57.964092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4a3a-2cd4-4574-8ce5-41ea6ad1ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:57.964689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4a3a-2cd4-4574-8ce5-41ea6ad1ad36 None admin] PATH_INFO: `/v3/projects/63202f1968a64d16936ada4895d02654/users/5c85fe8a38f6491ebff4972f42b84145/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:57.966871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d4a3a-2cd4-4574-8ce5-41ea6ad1ad36 None admin] RBAC: Authorizing `identity:create_grant(project_id=63202f1968a64d16936ada4895d02654, user_id=5c85fe8a38f6491ebff4972f42b84145, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:57.968738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d4a3a-2cd4-4574-8ce5-41ea6ad1ad36 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:58.030654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 69/140] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:03:57 2022] PUT /identity/v3/projects/63202f1968a64d16936ada4895d02654/users/5c85fe8a38f6491ebff4972f42b84145/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:03:58.032342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4a3a-2cd4-4574-8ce5-41ea6ad1ad36 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:58.041969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 72/141] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:03:58.080526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4c8f6-0c57-4a44-b7be-e5337f7c7b54 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:58.242478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4a3a-2cd4-4574-8ce5-41ea6ad1ad36 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:58.276093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4c8f6-0c57-4a44-b7be-e5337f7c7b54 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:58.310702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:58.349076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed735452-b2b2-4b9b-b602-f67885259474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:58.350148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed735452-b2b2-4b9b-b602-f67885259474 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.350619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed735452-b2b2-4b9b-b602-f67885259474 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.351103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed735452-b2b2-4b9b-b602-f67885259474 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:58.352495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed735452-b2b2-4b9b-b602-f67885259474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:58.354147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed735452-b2b2-4b9b-b602-f67885259474 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:58.355906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 70/142] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:03:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:58.361382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c864e-7070-4580-86c5-c5b3295ed47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:58.361882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed735452-b2b2-4b9b-b602-f67885259474 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:58.362075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c864e-7070-4580-86c5-c5b3295ed47c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.362362 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c864e-7070-4580-86c5-c5b3295ed47c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.362633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c864e-7070-4580-86c5-c5b3295ed47c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:58.375494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c864e-7070-4580-86c5-c5b3295ed47c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ea9c864e-7070-4580-86c5-c5b3295ed47c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:03:58.381227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:03:58.382147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:03:58.383329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 73/143] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:03:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:03:58.389951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c864e-7070-4580-86c5-c5b3295ed47c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:58.413381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:58.491884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed735452-b2b2-4b9b-b602-f67885259474 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:58.530565 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eda5d4-7e5f-4aec-8001-eb3ff44949a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:58.531706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eda5d4-7e5f-4aec-8001-eb3ff44949a3 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.532179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eda5d4-7e5f-4aec-8001-eb3ff44949a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.532715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eda5d4-7e5f-4aec-8001-eb3ff44949a3 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:58.533803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eda5d4-7e5f-4aec-8001-eb3ff44949a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:58.534831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c864e-7070-4580-86c5-c5b3295ed47c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:58.535794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eda5d4-7e5f-4aec-8001-eb3ff44949a3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:58.581706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:58.582360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.582653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.582975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:58.583663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:58.583967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:58.585484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:58.599750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 74/144] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:03:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:58.605213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:58.633070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 71/145] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:03:58 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:03:58.649468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:58.727641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37669-dc3c-4c29-8010-29c6592e8fd0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:58.763856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bd2e0-ebe5-4b87-a760-2bf187938ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:58.764554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bd2e0-ebe5-4b87-a760-2bf187938ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.764838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bd2e0-ebe5-4b87-a760-2bf187938ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.765161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bd2e0-ebe5-4b87-a760-2bf187938ae1 None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:58.766349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bd2e0-ebe5-4b87-a760-2bf187938ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:58.767810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bd2e0-ebe5-4b87-a760-2bf187938ae1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:58.769445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 75/146] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:03:58 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:03:58.775127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eda5d4-7e5f-4aec-8001-eb3ff44949a3 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:58.892582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:58.912164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eda5d4-7e5f-4aec-8001-eb3ff44949a3 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:58.950127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d9f9-34e8-4e4a-a992-e0c2ffa319b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:58.950835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d9f9-34e8-4e4a-a992-e0c2ffa319b8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:58.952111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d9f9-34e8-4e4a-a992-e0c2ffa319b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:58.952111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d9f9-34e8-4e4a-a992-e0c2ffa319b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:59.027113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d9f9-34e8-4e4a-a992-e0c2ffa319b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:59.028852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d9f9-34e8-4e4a-a992-e0c2ffa319b8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:59.114515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:59.133753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 72/147] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:03:59.140058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bd2e0-ebe5-4b87-a760-2bf187938ae1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:59.261644 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bd2e0-ebe5-4b87-a760-2bf187938ae1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:59.269285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:03:59.297409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac9341-5395-4d82-878f-ae31e8d4419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:59.298032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9341-5395-4d82-878f-ae31e8d4419e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:59.298313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9341-5395-4d82-878f-ae31e8d4419e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:59.298587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9341-5395-4d82-878f-ae31e8d4419e None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:59.299725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9341-5395-4d82-878f-ae31e8d4419e None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:59.301192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9341-5395-4d82-878f-ae31e8d4419e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:59.303106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 76/148] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:03:59 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:03:59.309041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d9f9-34e8-4e4a-a992-e0c2ffa319b8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:03:59.433184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d9f9-34e8-4e4a-a992-e0c2ffa319b8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:03:59.475908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b56be-e87d-480a-b4c8-8ec6188793db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:03:59.476546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b56be-e87d-480a-b4c8-8ec6188793db None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:03:59.476826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b56be-e87d-480a-b4c8-8ec6188793db None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:03:59.477108 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b56be-e87d-480a-b4c8-8ec6188793db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:03:59.477903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b56be-e87d-480a-b4c8-8ec6188793db None admin] RBAC: Adding query filter params (role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4, user.id=5c85fe8a38f6491ebff4972f42b84145) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:03:59.478229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b56be-e87d-480a-b4c8-8ec6188793db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:03:59.479689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b56be-e87d-480a-b4c8-8ec6188793db None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:03:59.489260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 73/149] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:03:59 2022] GET /identity/v3/role_assignments?user.id=5c85fe8a38f6491ebff4972f42b84145&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:00.134037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db4a8-a2bb-4b9d-91ea-ff62308da13f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.134413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db4a8-a2bb-4b9d-91ea-ff62308da13f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.134611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db4a8-a2bb-4b9d-91ea-ff62308da13f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.136094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 77/150] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:00.142652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280c74-9f9f-4a90-856f-a972481a2ccb None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.142937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280c74-9f9f-4a90-856f-a972481a2ccb None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.143207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280c74-9f9f-4a90-856f-a972481a2ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.166942 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e4280c74-9f9f-4a90-856f-a972481a2ccb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:00.168140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e4280c74-9f9f-4a90-856f-a972481a2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:00.213211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:00.239507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 74/151] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:00.282324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572db4a8-a2bb-4b9d-91ea-ff62308da13f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:00.404473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572db4a8-a2bb-4b9d-91ea-ff62308da13f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:00.442298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7ea9f-b0b3-4f76-99ce-5c992e3db481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:00.442975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ea9f-b0b3-4f76-99ce-5c992e3db481 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.443264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ea9f-b0b3-4f76-99ce-5c992e3db481 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.443539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ea9f-b0b3-4f76-99ce-5c992e3db481 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.454622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7ea9f-b0b3-4f76-99ce-5c992e3db481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c5f7ea9f-b0b3-4f76-99ce-5c992e3db481 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:00.459434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:00.460285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:00.461542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 78/152] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:00.467315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4280c74-9f9f-4a90-856f-a972481a2ccb None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:00.522072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834cbb0-78be-49f6-831a-a3ad5a9b9333 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.522369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834cbb0-78be-49f6-831a-a3ad5a9b9333 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.522625 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834cbb0-78be-49f6-831a-a3ad5a9b9333 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.523956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 79/153] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:00.537010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767782-0601-4c67-b0f3-971b55ff9e4b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.537297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767782-0601-4c67-b0f3-971b55ff9e4b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.537570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767782-0601-4c67-b0f3-971b55ff9e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.556638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d2767782-0601-4c67-b0f3-971b55ff9e4b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:00.557975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d2767782-0601-4c67-b0f3-971b55ff9e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:00.588678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:00.614119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4280c74-9f9f-4a90-856f-a972481a2ccb None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:00.666330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 80/154] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:00.681904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:00.682526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.682807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.683079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.683757 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:00.684056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:00.685793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:00.698000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 75/155] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:00.704161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767782-0601-4c67-b0f3-971b55ff9e4b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:00.705562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:00.781449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:00.877875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cb4fb-85eb-45be-869a-f41bd2478821 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:00.910085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767782-0601-4c67-b0f3-971b55ff9e4b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:00.949121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f22b6c-7c3a-4b85-ae75-48980d31d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:00.951217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f22b6c-7c3a-4b85-ae75-48980d31d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.951889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f22b6c-7c3a-4b85-ae75-48980d31d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.954219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f22b6c-7c3a-4b85-ae75-48980d31d5d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.958031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff69590-5552-443c-90a2-e61ddc36df9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:00.958901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69590-5552-443c-90a2-e61ddc36df9d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.959597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69590-5552-443c-90a2-e61ddc36df9d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.960773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69590-5552-443c-90a2-e61ddc36df9d None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.964233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff69590-5552-443c-90a2-e61ddc36df9d None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:00.966401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff69590-5552-443c-90a2-e61ddc36df9d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:00.969016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 81/156] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:00 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:00.972682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c637d6-ba50-4c8f-9e24-af2671b95caa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:00.975219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c637d6-ba50-4c8f-9e24-af2671b95caa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:00.975701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c637d6-ba50-4c8f-9e24-af2671b95caa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:00.977186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 82/157] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:00.982796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c637d6-ba50-4c8f-9e24-af2671b95caa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:00.983541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f22b6c-7c3a-4b85-ae75-48980d31d5d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-68f22b6c-7c3a-4b85-ae75-48980d31d5d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:00.989423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:00.990318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:00.991092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:00.995349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 76/158] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:01.007335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f22b6c-7c3a-4b85-ae75-48980d31d5d7 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:01.053494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:01.171854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:01.180728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f22b6c-7c3a-4b85-ae75-48980d31d5d7 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:01.213961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c637d6-ba50-4c8f-9e24-af2671b95caa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:01.249641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3346aa-6fb0-4f65-8745-917a143c020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:01.250655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3346aa-6fb0-4f65-8745-917a143c020f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:01.251135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3346aa-6fb0-4f65-8745-917a143c020f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:01.251666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3346aa-6fb0-4f65-8745-917a143c020f None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:01.252601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3346aa-6fb0-4f65-8745-917a143c020f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:01.253094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3346aa-6fb0-4f65-8745-917a143c020f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:01.255181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3346aa-6fb0-4f65-8745-917a143c020f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:01.271886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 77/159] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:01.273603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f295f74-df01-4290-bb2a-12873e7cbe2c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:01.274085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f295f74-df01-4290-bb2a-12873e7cbe2c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:01.274549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f295f74-df01-4290-bb2a-12873e7cbe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:01.304490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443d58f-8f4b-4b14-8336-c6be33898aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:01.305120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443d58f-8f4b-4b14-8336-c6be33898aec None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:01.305400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443d58f-8f4b-4b14-8336-c6be33898aec None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:01.305674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443d58f-8f4b-4b14-8336-c6be33898aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:01.308812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-1f295f74-df01-4290-bb2a-12873e7cbe2c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:01.310327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1f295f74-df01-4290-bb2a-12873e7cbe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:01.429786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 78/160] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:01.431052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f295f74-df01-4290-bb2a-12873e7cbe2c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:01.448609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443d58f-8f4b-4b14-8336-c6be33898aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:01.450663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443d58f-8f4b-4b14-8336-c6be33898aec None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:01.521085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:01.620669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:01.630572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f295f74-df01-4290-bb2a-12873e7cbe2c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:01.633985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 83/161] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:01.635074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443d58f-8f4b-4b14-8336-c6be33898aec None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:01.718029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66348029-7aab-470f-9eb4-53158d2b766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:01.719023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348029-7aab-470f-9eb4-53158d2b766c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:01.719524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348029-7aab-470f-9eb4-53158d2b766c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:01.719985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348029-7aab-470f-9eb4-53158d2b766c None admin] PATH_INFO: `/v3/users/54c3d35f7ad34e87bf733354f4b0f781` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:01.721348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66348029-7aab-470f-9eb4-53158d2b766c None admin] RBAC: Authorizing `identity:get_user(user_id=54c3d35f7ad34e87bf733354f4b0f781)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:01.723737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66348029-7aab-470f-9eb4-53158d2b766c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:01.728361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 79/162] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:01 2022] GET /identity/v3/users/54c3d35f7ad34e87bf733354f4b0f781 => generated 247 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:01.730670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b849d-4903-4cb7-8405-eb73d2322050 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:01.733042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b849d-4903-4cb7-8405-eb73d2322050 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:01.733528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b849d-4903-4cb7-8405-eb73d2322050 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:01.735966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 80/163] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:01.737797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b849d-4903-4cb7-8405-eb73d2322050 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:01.774305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443d58f-8f4b-4b14-8336-c6be33898aec None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:01.832399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:01.846935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449895-2a22-43e2-a500-e6b3864b162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:01.848686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449895-2a22-43e2-a500-e6b3864b162a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:01.849535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449895-2a22-43e2-a500-e6b3864b162a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:01.850017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449895-2a22-43e2-a500-e6b3864b162a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:01.864703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce449895-2a22-43e2-a500-e6b3864b162a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ce449895-2a22-43e2-a500-e6b3864b162a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:01.873036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:01.874142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:01.875192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:01.883175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 84/164] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:01.883175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449895-2a22-43e2-a500-e6b3864b162a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:01.927315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b849d-4903-4cb7-8405-eb73d2322050 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.006853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326b700-b519-449a-9441-c1431f6a7add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.008537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b700-b519-449a-9441-c1431f6a7add None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.009140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b700-b519-449a-9441-c1431f6a7add None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.010244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b700-b519-449a-9441-c1431f6a7add None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.013388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326b700-b519-449a-9441-c1431f6a7add None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:02.015297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326b700-b519-449a-9441-c1431f6a7add None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:02.017929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 81/165] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:01 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:02.020176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4aac-0d86-4de0-aa70-2191b2581511 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.021828 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4aac-0d86-4de0-aa70-2191b2581511 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.023143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4aac-0d86-4de0-aa70-2191b2581511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.058080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-75af4aac-0d86-4de0-aa70-2191b2581511 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:02.061241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-75af4aac-0d86-4de0-aa70-2191b2581511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:02.091848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:02.103896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449895-2a22-43e2-a500-e6b3864b162a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.138441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f06b0-7036-4330-a16c-bcb70a41cbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.139059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f06b0-7036-4330-a16c-bcb70a41cbfa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.139345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f06b0-7036-4330-a16c-bcb70a41cbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.139916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f06b0-7036-4330-a16c-bcb70a41cbfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.161396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 82/166] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:02.162247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af4aac-0d86-4de0-aa70-2191b2581511 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:02.257264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:02.270167 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af4aac-0d86-4de0-aa70-2191b2581511 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.278396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f06b0-7036-4330-a16c-bcb70a41cbfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:02.280358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f06b0-7036-4330-a16c-bcb70a41cbfa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:02.308018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.308727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.308970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.309227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.310779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:02.311142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:02.312686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:02.321793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 83/167] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:02.322633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:02.343372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:02.433207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3746a-8bc5-49a0-9cdc-a6e16bf34b6f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.468412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 85/168] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:02.469318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f06b0-7036-4330-a16c-bcb70a41cbfa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:02.473393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.474012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.474295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.474566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.475301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] RBAC: Adding query filter params (role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4, user.id=5c85fe8a38f6491ebff4972f42b84145) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:02.475607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:02.477113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:02.484601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 84/169] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/role_assignments?user.id=5c85fe8a38f6491ebff4972f42b84145&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:02.485527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:02.606130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:02.627672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d2db-7142-473d-b70d-3b5f774cb3b0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.649405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:02.666724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29d169-234a-4fd2-9336-99dfbd4c4ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.666929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f06b0-7036-4330-a16c-bcb70a41cbfa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.667432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29d169-234a-4fd2-9336-99dfbd4c4ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.667723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29d169-234a-4fd2-9336-99dfbd4c4ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.668005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29d169-234a-4fd2-9336-99dfbd4c4ba2 None admin] PATH_INFO: `/v3/users/43c70349555f4da0af8dbb54f227c1ab` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.669449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29d169-234a-4fd2-9336-99dfbd4c4ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=43c70349555f4da0af8dbb54f227c1ab)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:02.671230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29d169-234a-4fd2-9336-99dfbd4c4ba2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:02.673020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 85/170] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/users/43c70349555f4da0af8dbb54f227c1ab => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:02.674286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f722a-38a7-435f-9592-991c894654f7 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.674540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f722a-38a7-435f-9592-991c894654f7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.674819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f722a-38a7-435f-9592-991c894654f7 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.676203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 86/171] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:02.676786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f722a-38a7-435f-9592-991c894654f7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:02.746346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a21653-13e7-4837-873e-3b3f6774eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.747918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21653-13e7-4837-873e-3b3f6774eff7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.748232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21653-13e7-4837-873e-3b3f6774eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.749190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21653-13e7-4837-873e-3b3f6774eff7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.760532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a21653-13e7-4837-873e-3b3f6774eff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-50a21653-13e7-4837-873e-3b3f6774eff7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:02.766584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:02.767461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 86/172] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:02.768759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a21653-13e7-4837-873e-3b3f6774eff7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:02.799271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f722a-38a7-435f-9592-991c894654f7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.846712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19505b5-ac66-4e43-8f9a-e0a5a9624158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.847617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19505b5-ac66-4e43-8f9a-e0a5a9624158 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.847896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19505b5-ac66-4e43-8f9a-e0a5a9624158 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.848168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19505b5-ac66-4e43-8f9a-e0a5a9624158 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.849633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19505b5-ac66-4e43-8f9a-e0a5a9624158 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:02.851676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19505b5-ac66-4e43-8f9a-e0a5a9624158 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:02.853652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 87/173] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:02.855052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12b52-2fbe-477a-9900-02c5668a259b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.855330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12b52-2fbe-477a-9900-02c5668a259b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.855604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12b52-2fbe-477a-9900-02c5668a259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.879703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-08f12b52-2fbe-477a-9900-02c5668a259b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:02.880952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-08f12b52-2fbe-477a-9900-02c5668a259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:02.901976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a21653-13e7-4837-873e-3b3f6774eff7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:02.904239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:02.954401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794ca7-833b-4e81-ac7a-2b2fde74f86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:02.955099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794ca7-833b-4e81-ac7a-2b2fde74f86d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:02.955377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794ca7-833b-4e81-ac7a-2b2fde74f86d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:02.955699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794ca7-833b-4e81-ac7a-2b2fde74f86d None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:02.956924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794ca7-833b-4e81-ac7a-2b2fde74f86d None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:02.958462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794ca7-833b-4e81-ac7a-2b2fde74f86d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:02.960368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 87/174] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:02.961018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794ca7-833b-4e81-ac7a-2b2fde74f86d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:02.973964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 88/175] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:02.974986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12b52-2fbe-477a-9900-02c5668a259b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.000614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.074477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794ca7-833b-4e81-ac7a-2b2fde74f86d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.082070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12b52-2fbe-477a-9900-02c5668a259b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.107569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c197e0-445d-446b-9826-a2608ed6bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.108169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c197e0-445d-446b-9826-a2608ed6bc54 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.108548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c197e0-445d-446b-9826-a2608ed6bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.108821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c197e0-445d-446b-9826-a2608ed6bc54 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.109511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c197e0-445d-446b-9826-a2608ed6bc54 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:03.109811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c197e0-445d-446b-9826-a2608ed6bc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:03.111184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c197e0-445d-446b-9826-a2608ed6bc54 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:03.116153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.116783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.117059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.117325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.118045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4, user.id=54c3d35f7ad34e87bf733354f4b0f781) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:03.118350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:03.119128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 88/176] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:03.119852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:03.120110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ada4-b40f-4fd4-871c-56c9e9425459 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.120418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ada4-b40f-4fd4-871c-56c9e9425459 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.120693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ada4-b40f-4fd4-871c-56c9e9425459 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.122614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 89/177] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:03.123207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ada4-b40f-4fd4-871c-56c9e9425459 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.127311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 89/178] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:02 2022] GET /identity/v3/role_assignments?user.id=54c3d35f7ad34e87bf733354f4b0f781&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:03.128065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.144926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.230127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.244625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9cb3-a45d-4053-83ab-13a41af156d2 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.251435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ada4-b40f-4fd4-871c-56c9e9425459 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.285143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de65e0-98c9-4b65-9f13-6e98367e96bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.285796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de65e0-98c9-4b65-9f13-6e98367e96bc None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.286072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de65e0-98c9-4b65-9f13-6e98367e96bc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.286342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de65e0-98c9-4b65-9f13-6e98367e96bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.293016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e28309-c73b-4a37-b797-fdfad1cc6768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.294266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e28309-c73b-4a37-b797-fdfad1cc6768 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.294655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e28309-c73b-4a37-b797-fdfad1cc6768 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.294937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e28309-c73b-4a37-b797-fdfad1cc6768 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/users/43c70349555f4da0af8dbb54f227c1ab/roles/d820a202bc2440d7b1f2a7190d4cae7c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.296937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e28309-c73b-4a37-b797-fdfad1cc6768 None admin] RBAC: Authorizing `identity:create_grant(project_id=299bafe38f4d4f39a7408242bcc8e7a4, user_id=43c70349555f4da0af8dbb54f227c1ab, role_id=d820a202bc2440d7b1f2a7190d4cae7c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:03.298321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de65e0-98c9-4b65-9f13-6e98367e96bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:03.298434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e28309-c73b-4a37-b797-fdfad1cc6768 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-23de65e0-98c9-4b65-9f13-6e98367e96bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:03.303090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:03.304017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:03.305354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 90/179] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:03.306136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ef1ae-4c94-44aa-8c36-e8d347f0ba8e None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.307084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ef1ae-4c94-44aa-8c36-e8d347f0ba8e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.307366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ef1ae-4c94-44aa-8c36-e8d347f0ba8e None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.308757 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 91/180] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:03.310310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e02da-f224-4c16-bdd7-de10837f3b9f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.310509 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e02da-f224-4c16-bdd7-de10837f3b9f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.310773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e02da-f224-4c16-bdd7-de10837f3b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.328208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-856e02da-f224-4c16-bdd7-de10837f3b9f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:03.329410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-856e02da-f224-4c16-bdd7-de10837f3b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:03.362001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 90/181] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:03 2022] PUT /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/users/43c70349555f4da0af8dbb54f227c1ab/roles/d820a202bc2440d7b1f2a7190d4cae7c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:03.362914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e28309-c73b-4a37-b797-fdfad1cc6768 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.411276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 92/182] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:03.412146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e02da-f224-4c16-bdd7-de10837f3b9f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.414769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.489686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e28309-c73b-4a37-b797-fdfad1cc6768 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.527324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e02da-f224-4c16-bdd7-de10837f3b9f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.529140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1a4d-e09e-488e-86f9-064d8efda8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.530045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1a4d-e09e-488e-86f9-064d8efda8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.530325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1a4d-e09e-488e-86f9-064d8efda8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.531446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1a4d-e09e-488e-86f9-064d8efda8b3 None admin] PATH_INFO: `/v3/users/5c85fe8a38f6491ebff4972f42b84145` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.532736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f1a4d-e09e-488e-86f9-064d8efda8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=5c85fe8a38f6491ebff4972f42b84145)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:03.534440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f1a4d-e09e-488e-86f9-064d8efda8b3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:03.536217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 91/183] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:03 2022] GET /identity/v3/users/5c85fe8a38f6491ebff4972f42b84145 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:03.537665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dbbf5-8f7c-450a-998d-bc00ec1418de None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.537948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dbbf5-8f7c-450a-998d-bc00ec1418de None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.538221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dbbf5-8f7c-450a-998d-bc00ec1418de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.557067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-633dbbf5-8f7c-450a-998d-bc00ec1418de None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:03.558258 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-633dbbf5-8f7c-450a-998d-bc00ec1418de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:03.561635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.566788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.567250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.567575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.567834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.568647 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:03.572408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:03.572408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:03.580349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 93/184] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:03.580598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.629068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 92/185] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:03.633185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dbbf5-8f7c-450a-998d-bc00ec1418de None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.658731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.698174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6fa17-6080-4067-9ec2-955c672c7b0b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.732329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d646e-109b-4b9e-b4ce-2514c0020ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.732969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d646e-109b-4b9e-b4ce-2514c0020ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.733246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d646e-109b-4b9e-b4ce-2514c0020ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.733517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d646e-109b-4b9e-b4ce-2514c0020ec4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.743522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d646e-109b-4b9e-b4ce-2514c0020ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:03.744804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dbbf5-8f7c-450a-998d-bc00ec1418de None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-7e0d646e-109b-4b9e-b4ce-2514c0020ec4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:03.748871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:03.749781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:03.750583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 94/186] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:03.751332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d646e-109b-4b9e-b4ce-2514c0020ec4 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.784266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1680b0-4a06-4c55-9aa0-18f9d9d33c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.784906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1680b0-4a06-4c55-9aa0-18f9d9d33c40 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.785207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1680b0-4a06-4c55-9aa0-18f9d9d33c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.785480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1680b0-4a06-4c55-9aa0-18f9d9d33c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.796493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.861677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1680b0-4a06-4c55-9aa0-18f9d9d33c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:03.863181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d646e-109b-4b9e-b4ce-2514c0020ec4 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:03.863285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1680b0-4a06-4c55-9aa0-18f9d9d33c40 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:03.888504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:03.899804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200bc7-1cd5-4fa9-879d-c656157072f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:03.900507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200bc7-1cd5-4fa9-879d-c656157072f9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:03.900765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200bc7-1cd5-4fa9-879d-c656157072f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:03.901037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b200bc7-1cd5-4fa9-879d-c656157072f9 None admin] PATH_INFO: `/v3/users/2e7fe446aaea41eda34c7095c3afc2a9` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:03.916594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b200bc7-1cd5-4fa9-879d-c656157072f9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e7fe446aaea41eda34c7095c3afc2a9)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:03.918320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b200bc7-1cd5-4fa9-879d-c656157072f9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:03.920700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 95/187] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:03 2022] GET /identity/v3/users/2e7fe446aaea41eda34c7095c3afc2a9 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:03.921305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200bc7-1cd5-4fa9-879d-c656157072f9 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:03.993940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 93/188] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:03.993940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1680b0-4a06-4c55-9aa0-18f9d9d33c40 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.030016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b200bc7-1cd5-4fa9-879d-c656157072f9 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.036802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:04.064607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9a22d-e6f2-41fa-aee9-845f871e5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.065248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a22d-e6f2-41fa-aee9-845f871e5e55 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.065526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a22d-e6f2-41fa-aee9-845f871e5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.065795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a22d-e6f2-41fa-aee9-845f871e5e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.066896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9a22d-e6f2-41fa-aee9-845f871e5e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.068483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9a22d-e6f2-41fa-aee9-845f871e5e55 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.070042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 96/189] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:04.070881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9a22d-e6f2-41fa-aee9-845f871e5e55 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.109689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1680b0-4a06-4c55-9aa0-18f9d9d33c40 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.125879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:04.148916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.149532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.149804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.150069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.150732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:04.151029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.152418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.162495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 94/190] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:04.168482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.181916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9a22d-e6f2-41fa-aee9-845f871e5e55 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.216651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9f50b-ed1d-4d46-97b8-7a92e117b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.217342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f50b-ed1d-4d46-97b8-7a92e117b709 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.217628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f50b-ed1d-4d46-97b8-7a92e117b709 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.217957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f50b-ed1d-4d46-97b8-7a92e117b709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.269951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c338d-d31c-468f-806d-5ad890e7cc6d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.271468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:04.287599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f50b-ed1d-4d46-97b8-7a92e117b709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.289107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f50b-ed1d-4d46-97b8-7a92e117b709 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.311243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1b9b4-d31a-4b6b-9b43-c827951a4a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.311863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1b9b4-d31a-4b6b-9b43-c827951a4a04 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.312141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1b9b4-d31a-4b6b-9b43-c827951a4a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.312446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1b9b4-d31a-4b6b-9b43-c827951a4a04 None admin] PATH_INFO: `/v3/projects/63202f1968a64d16936ada4895d02654` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.313564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1b9b4-d31a-4b6b-9b43-c827951a4a04 None admin] RBAC: Authorizing `identity:get_project(project_id=63202f1968a64d16936ada4895d02654)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.314976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1b9b4-d31a-4b6b-9b43-c827951a4a04 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.316783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 95/191] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:04 2022] GET /identity/v3/projects/63202f1968a64d16936ada4895d02654 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:04.317354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1b9b4-d31a-4b6b-9b43-c827951a4a04 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.345500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:04.401432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 97/192] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:04.402298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9f50b-ed1d-4d46-97b8-7a92e117b709 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.428287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1b9b4-d31a-4b6b-9b43-c827951a4a04 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.463609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d363d-553d-49e1-9409-ce606e8974c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.464221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d363d-553d-49e1-9409-ce606e8974c0 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.464533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d363d-553d-49e1-9409-ce606e8974c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.464812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d363d-553d-49e1-9409-ce606e8974c0 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.465475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d363d-553d-49e1-9409-ce606e8974c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.466937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d363d-553d-49e1-9409-ce606e8974c0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.504569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9f50b-ed1d-4d46-97b8-7a92e117b709 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.538704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b811-13bb-4e97-b589-7b189f48bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.539260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b811-13bb-4e97-b589-7b189f48bff8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.539539 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b811-13bb-4e97-b589-7b189f48bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.539815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b811-13bb-4e97-b589-7b189f48bff8 None admin] PATH_INFO: `/v3/users/2e7fe446aaea41eda34c7095c3afc2a9` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.540940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352b811-13bb-4e97-b589-7b189f48bff8 None admin] RBAC: Authorizing `identity:get_user(user_id=2e7fe446aaea41eda34c7095c3afc2a9)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.542370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352b811-13bb-4e97-b589-7b189f48bff8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.544266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 98/193] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:04 2022] GET /identity/v3/users/2e7fe446aaea41eda34c7095c3afc2a9 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:04.544774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b811-13bb-4e97-b589-7b189f48bff8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.561931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 96/194] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:04 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:04.565688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d363d-553d-49e1-9409-ce606e8974c0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.584331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:04.603386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:04.688993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d363d-553d-49e1-9409-ce606e8974c0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.693818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b811-13bb-4e97-b589-7b189f48bff8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.730836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9e175-4aff-4c2c-9125-9fa29cc955c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.731569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9e175-4aff-4c2c-9125-9fa29cc955c7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.731839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9e175-4aff-4c2c-9125-9fa29cc955c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.732110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9e175-4aff-4c2c-9125-9fa29cc955c7 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.733424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9e175-4aff-4c2c-9125-9fa29cc955c7 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.735075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9e175-4aff-4c2c-9125-9fa29cc955c7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.737011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 97/195] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:04 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:04.737811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9e175-4aff-4c2c-9125-9fa29cc955c7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.743820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.744779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.745230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.745672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.747153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] RBAC: Adding query filter params (role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=63202f1968a64d16936ada4895d02654, user.id=5c85fe8a38f6491ebff4972f42b84145) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:04.747675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.749870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.757769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 99/196] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:04 2022] GET /identity/v3/role_assignments?user.id=5c85fe8a38f6491ebff4972f42b84145&scope.project.id=63202f1968a64d16936ada4895d02654&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:04.759156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:04.863610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:04.868943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:04.870385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9e175-4aff-4c2c-9125-9fa29cc955c7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.893216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf3a6d-bfa4-49c5-be3d-a4b556c99464 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:04.922095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39e594-7239-43c9-9219-6c0359d28553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.923697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39e594-7239-43c9-9219-6c0359d28553 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.924553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39e594-7239-43c9-9219-6c0359d28553 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.925018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39e594-7239-43c9-9219-6c0359d28553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.941084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:04.941885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:04.942265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:04.942617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:04.943483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=8e424d66a95a494a86f95591ae27a0e3, user.id=2e7fe446aaea41eda34c7095c3afc2a9) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:04.943937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:04.946529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:04.954177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 100/197] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:04 2022] GET /identity/v3/role_assignments?user.id=2e7fe446aaea41eda34c7095c3afc2a9&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:05.029725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39e594-7239-43c9-9219-6c0359d28553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:05.031572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39e594-7239-43c9-9219-6c0359d28553 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:05.140697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:05.149673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 98/198] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:05.157028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:05.277761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df54e8-1ed0-4f94-9dc8-7343fe1da044 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:05.327497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25563d5-f6f3-4448-98ec-2b504fa3084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:05.328608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25563d5-f6f3-4448-98ec-2b504fa3084a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:05.329130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25563d5-f6f3-4448-98ec-2b504fa3084a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:05.329623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25563d5-f6f3-4448-98ec-2b504fa3084a None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:05.330966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25563d5-f6f3-4448-98ec-2b504fa3084a None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:05.332818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25563d5-f6f3-4448-98ec-2b504fa3084a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:05.335142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 101/199] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:05 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:05.341715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39e594-7239-43c9-9219-6c0359d28553 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:05.449009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39e594-7239-43c9-9219-6c0359d28553 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:05.485759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edd920-38c5-4c16-9e69-8914f9d7d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:05.486763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edd920-38c5-4c16-9e69-8914f9d7d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:05.487291 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edd920-38c5-4c16-9e69-8914f9d7d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:05.487782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edd920-38c5-4c16-9e69-8914f9d7d8a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:05.488821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edd920-38c5-4c16-9e69-8914f9d7d8a9 None admin] RBAC: Adding query filter params (role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=8e424d66a95a494a86f95591ae27a0e3, user.id=2e7fe446aaea41eda34c7095c3afc2a9) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:05.489354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edd920-38c5-4c16-9e69-8914f9d7d8a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:05.490980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edd920-38c5-4c16-9e69-8914f9d7d8a9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:05.497229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 99/200] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:05 2022] GET /identity/v3/role_assignments?user.id=2e7fe446aaea41eda34c7095c3afc2a9&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:05.595457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613b33-3aa1-4f00-ab74-8d1317f89c5d None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:05.595816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613b33-3aa1-4f00-ab74-8d1317f89c5d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:05.596023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d613b33-3aa1-4f00-ab74-8d1317f89c5d None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:05.597466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 102/201] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:05.603296 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589817-3ee7-4c92-8906-371b513394c1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:05.604229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589817-3ee7-4c92-8906-371b513394c1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:05.604756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589817-3ee7-4c92-8906-371b513394c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:05.630974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a4589817-3ee7-4c92-8906-371b513394c1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:05.632604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a4589817-3ee7-4c92-8906-371b513394c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:05.709362 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:05.721590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 100/202] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:05.745075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d613b33-3aa1-4f00-ab74-8d1317f89c5d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:05.762645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:05.865913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d613b33-3aa1-4f00-ab74-8d1317f89c5d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:05.913858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70e2f-1dd0-4393-aceb-d4c2a248ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:05.914818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70e2f-1dd0-4393-aceb-d4c2a248ee6e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:05.915360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70e2f-1dd0-4393-aceb-d4c2a248ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:05.915808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70e2f-1dd0-4393-aceb-d4c2a248ee6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:05.927069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e70e2f-1dd0-4393-aceb-d4c2a248ee6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-f4e70e2f-1dd0-4393-aceb-d4c2a248ee6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:05.941616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:05.942574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:05.943401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:05.945358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 103/203] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:05.951891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589817-3ee7-4c92-8906-371b513394c1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:06.063060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589817-3ee7-4c92-8906-371b513394c1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:06.098521 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:06.099393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:06.099828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:06.100238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:06.101069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:06.101517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:06.103090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:06.111799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 101/204] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:06.117443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70e2f-1dd0-4393-aceb-d4c2a248ee6e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:06.194630 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:06.220852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70e2f-1dd0-4393-aceb-d4c2a248ee6e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:06.255031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46759311-c1cf-4c53-a6ca-21c68dc5f13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:06.255922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46759311-c1cf-4c53-a6ca-21c68dc5f13b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:06.256391 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46759311-c1cf-4c53-a6ca-21c68dc5f13b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:06.256801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46759311-c1cf-4c53-a6ca-21c68dc5f13b None admin] PATH_INFO: `/v3/users/43c70349555f4da0af8dbb54f227c1ab` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:06.258048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46759311-c1cf-4c53-a6ca-21c68dc5f13b None admin] RBAC: Authorizing `identity:get_user(user_id=43c70349555f4da0af8dbb54f227c1ab)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:06.259652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46759311-c1cf-4c53-a6ca-21c68dc5f13b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:06.261486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 104/205] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:06 2022] GET /identity/v3/users/43c70349555f4da0af8dbb54f227c1ab => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:06.273639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:06.348830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:06.388971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398859-5190-4366-a1b1-c80fc45329a1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:06.431826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c179ce-9c45-4412-a9f1-2166c399a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:06.432832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c179ce-9c45-4412-a9f1-2166c399a73c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:06.433298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c179ce-9c45-4412-a9f1-2166c399a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:06.433770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c179ce-9c45-4412-a9f1-2166c399a73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:06.541540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c179ce-9c45-4412-a9f1-2166c399a73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:06.543244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c179ce-9c45-4412-a9f1-2166c399a73c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:06.594889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:06.660635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 102/206] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:06.665862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46759311-c1cf-4c53-a6ca-21c68dc5f13b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:06.833587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46759311-c1cf-4c53-a6ca-21c68dc5f13b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:06.886377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11166905-e97a-4253-bb15-9a8a7a9db7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:06.887025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166905-e97a-4253-bb15-9a8a7a9db7ae None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:06.887821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166905-e97a-4253-bb15-9a8a7a9db7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:06.888095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166905-e97a-4253-bb15-9a8a7a9db7ae None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:06.889267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11166905-e97a-4253-bb15-9a8a7a9db7ae None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:06.890732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11166905-e97a-4253-bb15-9a8a7a9db7ae None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:06.892382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 105/207] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:06 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:06.898607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c179ce-9c45-4412-a9f1-2166c399a73c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:07.040776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c179ce-9c45-4412-a9f1-2166c399a73c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:07.083287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a3f0e-98be-459a-a989-7e76024e0f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:07.083905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a3f0e-98be-459a-a989-7e76024e0f0e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.084179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a3f0e-98be-459a-a989-7e76024e0f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.084474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a3f0e-98be-459a-a989-7e76024e0f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.085207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a3f0e-98be-459a-a989-7e76024e0f0e None admin] RBAC: Adding query filter params (role.id=d820a202bc2440d7b1f2a7190d4cae7c, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4, user.id=43c70349555f4da0af8dbb54f227c1ab) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:07.085510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a3f0e-98be-459a-a989-7e76024e0f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:07.086946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a3f0e-98be-459a-a989-7e76024e0f0e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:07.096432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 103/208] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:06 2022] GET /identity/v3/role_assignments?user.id=43c70349555f4da0af8dbb54f227c1ab&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=d820a202bc2440d7b1f2a7190d4cae7c => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:07.453880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482799a-3828-4506-8399-cb7325bc0476 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.454273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482799a-3828-4506-8399-cb7325bc0476 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.454458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482799a-3828-4506-8399-cb7325bc0476 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.455766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 106/209] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:07.462240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c580-635b-4472-ba5a-a2c28bf706f5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.462517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c580-635b-4472-ba5a-a2c28bf706f5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.462784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c580-635b-4472-ba5a-a2c28bf706f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.484641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a2b6c580-635b-4472-ba5a-a2c28bf706f5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:07.485841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a2b6c580-635b-4472-ba5a-a2c28bf706f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:07.495629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:07.560148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedba586-65e4-46d8-b4c1-5df504015eb2 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.560455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedba586-65e4-46d8-b4c1-5df504015eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.560731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedba586-65e4-46d8-b4c1-5df504015eb2 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.562058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 107/210] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:07.562757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 104/211] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:07.568742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bacc1b-55fe-4bee-b5f1-9d3fb55597e0 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.569025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bacc1b-55fe-4bee-b5f1-9d3fb55597e0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.569298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bacc1b-55fe-4bee-b5f1-9d3fb55597e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.587485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6c580-635b-4472-ba5a-a2c28bf706f5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:07.592926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-60bacc1b-55fe-4bee-b5f1-9d3fb55597e0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:07.594365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-60bacc1b-55fe-4bee-b5f1-9d3fb55597e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:07.597819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:07.674665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 108/212] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:07.701276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bacc1b-55fe-4bee-b5f1-9d3fb55597e0 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:07.715082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6c580-635b-4472-ba5a-a2c28bf706f5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:07.759456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f57692-84f7-4b75-a4ce-4dddd56e9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:07.760945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57692-84f7-4b75-a4ce-4dddd56e9402 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.761385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57692-84f7-4b75-a4ce-4dddd56e9402 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.761803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f57692-84f7-4b75-a4ce-4dddd56e9402 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.776718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f57692-84f7-4b75-a4ce-4dddd56e9402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-50f57692-84f7-4b75-a4ce-4dddd56e9402 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:07.783005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:07.784087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:07.785106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:07.788294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 105/213] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:07.791969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020796-ef2c-467e-a1be-86c57d475298 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.792260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020796-ef2c-467e-a1be-86c57d475298 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.792730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020796-ef2c-467e-a1be-86c57d475298 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.794419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 106/214] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:07.797115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f020796-ef2c-467e-a1be-86c57d475298 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:07.801700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:07.818564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bacc1b-55fe-4bee-b5f1-9d3fb55597e0 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:07.858401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f6adf-94fb-4ffc-b67c-bca1ca1240f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:07.859098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f6adf-94fb-4ffc-b67c-bca1ca1240f5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.859419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f6adf-94fb-4ffc-b67c-bca1ca1240f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.859670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f6adf-94fb-4ffc-b67c-bca1ca1240f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.867646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:07.870589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f6adf-94fb-4ffc-b67c-bca1ca1240f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-7c4f6adf-94fb-4ffc-b67c-bca1ca1240f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:07.879700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:07.880623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 109/215] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:07.881430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c0f62-9e98-425d-9fec-643ad7cc33b7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.882253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c0f62-9e98-425d-9fec-643ad7cc33b7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.882253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c0f62-9e98-425d-9fec-643ad7cc33b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.898299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-219c0f62-9e98-425d-9fec-643ad7cc33b7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:07.900136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-219c0f62-9e98-425d-9fec-643ad7cc33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:07.916619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f020796-ef2c-467e-a1be-86c57d475298 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:07.952288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:07.952928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.953206 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.953475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.954133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:07.954433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:07.955802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:07.963599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 107/216] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:07.965241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:07.969090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 110/217] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:07.973658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650c2a8-7ce7-420a-b971-99b4b59651a1 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:07.974014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650c2a8-7ce7-420a-b971-99b4b59651a1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:07.974299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650c2a8-7ce7-420a-b971-99b4b59651a1 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:07.975685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 111/218] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:07.976234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650c2a8-7ce7-420a-b971-99b4b59651a1 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.033330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:08.066993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08240bb-358b-4adf-8238-0da1b0df2c5f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.078176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650c2a8-7ce7-420a-b971-99b4b59651a1 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.099888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a58bba-3b5e-4af9-8879-9551c50dd585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.100526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a58bba-3b5e-4af9-8879-9551c50dd585 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.100806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a58bba-3b5e-4af9-8879-9551c50dd585 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.101072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a58bba-3b5e-4af9-8879-9551c50dd585 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.101734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a58bba-3b5e-4af9-8879-9551c50dd585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:08.102029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a58bba-3b5e-4af9-8879-9551c50dd585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.103383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a58bba-3b5e-4af9-8879-9551c50dd585 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.105451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:08.111246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c6bd-2bdf-49ba-b2c1-daa0bc62ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.114222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 108/219] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:08.114340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c6bd-2bdf-49ba-b2c1-daa0bc62ea2c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.114340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c6bd-2bdf-49ba-b2c1-daa0bc62ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.114340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c6bd-2bdf-49ba-b2c1-daa0bc62ea2c None admin] PATH_INFO: `/v3/users/f3998425b98447779184bba8e684a34f` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.114558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc3e3-8f90-4ddc-9f5d-6fb15264df6e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.114558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc3e3-8f90-4ddc-9f5d-6fb15264df6e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.114558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc3e3-8f90-4ddc-9f5d-6fb15264df6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.128198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32c6bd-2bdf-49ba-b2c1-daa0bc62ea2c None admin] RBAC: Authorizing `identity:get_user(user_id=f3998425b98447779184bba8e684a34f)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.129732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32c6bd-2bdf-49ba-b2c1-daa0bc62ea2c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.130547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8b8bc3e3-8f90-4ddc-9f5d-6fb15264df6e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:08.131700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 112/220] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:07 2022] GET /identity/v3/users/f3998425b98447779184bba8e684a34f => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:08.131809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8b8bc3e3-8f90-4ddc-9f5d-6fb15264df6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:08.132838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c6bd-2bdf-49ba-b2c1-daa0bc62ea2c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.203180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 109/221] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:08.203860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bc3e3-8f90-4ddc-9f5d-6fb15264df6e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.232602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c6bd-2bdf-49ba-b2c1-daa0bc62ea2c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.266766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53164dde-a378-40fb-963c-2cea5086966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.267392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164dde-a378-40fb-963c-2cea5086966f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.267666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164dde-a378-40fb-963c-2cea5086966f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.267930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164dde-a378-40fb-963c-2cea5086966f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.269041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53164dde-a378-40fb-963c-2cea5086966f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.269172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:08.270468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53164dde-a378-40fb-963c-2cea5086966f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.272210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 113/222] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:08.272899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53164dde-a378-40fb-963c-2cea5086966f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.310492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bc3e3-8f90-4ddc-9f5d-6fb15264df6e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.331435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:08.343842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc416-cc08-41c2-ab8c-59fc01508a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.344518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc416-cc08-41c2-ab8c-59fc01508a8c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.344796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc416-cc08-41c2-ab8c-59fc01508a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.345065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc416-cc08-41c2-ab8c-59fc01508a8c None admin] PATH_INFO: `/v3/users/2e7fe446aaea41eda34c7095c3afc2a9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.346177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efc416-cc08-41c2-ab8c-59fc01508a8c None admin] RBAC: Authorizing `identity:get_user(user_id=2e7fe446aaea41eda34c7095c3afc2a9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.347629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efc416-cc08-41c2-ab8c-59fc01508a8c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.349293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 110/223] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:08 2022] GET /identity/v3/users/2e7fe446aaea41eda34c7095c3afc2a9 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:08.354094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc416-cc08-41c2-ab8c-59fc01508a8c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.375976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53164dde-a378-40fb-963c-2cea5086966f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.409622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2953e4-56e3-40bf-ae63-e8a63472724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.410282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2953e4-56e3-40bf-ae63-e8a63472724d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.410553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2953e4-56e3-40bf-ae63-e8a63472724d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.410818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2953e4-56e3-40bf-ae63-e8a63472724d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.449091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc416-cc08-41c2-ab8c-59fc01508a8c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.474320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:08.479007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2953e4-56e3-40bf-ae63-e8a63472724d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.480490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2953e4-56e3-40bf-ae63-e8a63472724d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.486020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06485038-3685-45db-9545-0edd2df69f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.486020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485038-3685-45db-9545-0edd2df69f75 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.486020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485038-3685-45db-9545-0edd2df69f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.486020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485038-3685-45db-9545-0edd2df69f75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.494350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06485038-3685-45db-9545-0edd2df69f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-06485038-3685-45db-9545-0edd2df69f75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:08.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:08.500283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 111/224] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:08.501138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06485038-3685-45db-9545-0edd2df69f75 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.537961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:08.585938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 114/225] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:08.585938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2953e4-56e3-40bf-ae63-e8a63472724d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.598695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06485038-3685-45db-9545-0edd2df69f75 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.632482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd5477-032a-4635-9aa7-7ac3b1fff4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.633172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd5477-032a-4635-9aa7-7ac3b1fff4ca None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.633461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd5477-032a-4635-9aa7-7ac3b1fff4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.633738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd5477-032a-4635-9aa7-7ac3b1fff4ca None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.634379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd5477-032a-4635-9aa7-7ac3b1fff4ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.635807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd5477-032a-4635-9aa7-7ac3b1fff4ca None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.678890 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2953e4-56e3-40bf-ae63-e8a63472724d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.711982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ac868-45b7-4c7a-8f65-69c07eca3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.712647 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ac868-45b7-4c7a-8f65-69c07eca3a94 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.712928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ac868-45b7-4c7a-8f65-69c07eca3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.713201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ac868-45b7-4c7a-8f65-69c07eca3a94 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.714301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 112/226] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:08 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:08.714435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ac868-45b7-4c7a-8f65-69c07eca3a94 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.715129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd5477-032a-4635-9aa7-7ac3b1fff4ca None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.716117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ac868-45b7-4c7a-8f65-69c07eca3a94 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.717866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 115/227] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:08 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:08.721392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ac868-45b7-4c7a-8f65-69c07eca3a94 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.753666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:08.780763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:08.841569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ac868-45b7-4c7a-8f65-69c07eca3a94 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.853648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd5477-032a-4635-9aa7-7ac3b1fff4ca None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:08.882934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2f0be-2449-4ccc-a11d-1f8992390db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.883660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2f0be-2449-4ccc-a11d-1f8992390db0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.883951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2f0be-2449-4ccc-a11d-1f8992390db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.884242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2f0be-2449-4ccc-a11d-1f8992390db0 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.886014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2f0be-2449-4ccc-a11d-1f8992390db0 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.886881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2f0be-2449-4ccc-a11d-1f8992390db0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.889171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 116/228] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:08 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:08.889895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2f0be-2449-4ccc-a11d-1f8992390db0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:08.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:08.897667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:08.897954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:08.898272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:08.899322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:08.899322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:08.900734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:08.914233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 113/229] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:08.915065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:09.008776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:09.018806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2f0be-2449-4ccc-a11d-1f8992390db0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:09.045716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf99489-6410-4c71-aba3-5e6ae619724c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:09.050328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:09.061140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075bf31-4799-460f-9138-a94d9dbf99a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:09.061806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bf31-4799-460f-9138-a94d9dbf99a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:09.062142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bf31-4799-460f-9138-a94d9dbf99a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:09.062423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075bf31-4799-460f-9138-a94d9dbf99a1 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3/users/2e7fe446aaea41eda34c7095c3afc2a9/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:09.064450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075bf31-4799-460f-9138-a94d9dbf99a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e424d66a95a494a86f95591ae27a0e3, user_id=2e7fe446aaea41eda34c7095c3afc2a9, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:09.065907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075bf31-4799-460f-9138-a94d9dbf99a1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:09.085719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:09.086333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:09.086622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:09.086898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:09.087633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] RBAC: Adding query filter params (role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=8e424d66a95a494a86f95591ae27a0e3, user.id=f3998425b98447779184bba8e684a34f) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:09.087942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:09.089424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:09.095416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 114/230] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:08 2022] GET /identity/v3/role_assignments?user.id=f3998425b98447779184bba8e684a34f&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:09.096055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:09.155704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 117/231] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:08 2022] PUT /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3/users/2e7fe446aaea41eda34c7095c3afc2a9/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:09.237116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa2c5-405c-40d0-b9d0-7aad3473dda5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:09.278653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206cfa-475f-4bc3-aec6-93acd5ac5f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:09.279230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206cfa-475f-4bc3-aec6-93acd5ac5f9f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:09.279510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206cfa-475f-4bc3-aec6-93acd5ac5f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:09.279792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7206cfa-475f-4bc3-aec6-93acd5ac5f9f None admin] PATH_INFO: `/v3/users/2e7fe446aaea41eda34c7095c3afc2a9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:09.280978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7206cfa-475f-4bc3-aec6-93acd5ac5f9f None admin] RBAC: Authorizing `identity:get_user(user_id=2e7fe446aaea41eda34c7095c3afc2a9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:09.283754 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7206cfa-475f-4bc3-aec6-93acd5ac5f9f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:09.284645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 115/232] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:09 2022] GET /identity/v3/users/2e7fe446aaea41eda34c7095c3afc2a9 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:09.290357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075bf31-4799-460f-9138-a94d9dbf99a1 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:09.403868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075bf31-4799-460f-9138-a94d9dbf99a1 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:09.441259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13e65-75cb-4269-87e9-1d662f7f98f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:09.441923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13e65-75cb-4269-87e9-1d662f7f98f8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:09.442206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13e65-75cb-4269-87e9-1d662f7f98f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:09.442481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13e65-75cb-4269-87e9-1d662f7f98f8 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:09.443683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13e65-75cb-4269-87e9-1d662f7f98f8 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:09.445299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13e65-75cb-4269-87e9-1d662f7f98f8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:09.447151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 118/233] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:09 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:09.452886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206cfa-475f-4bc3-aec6-93acd5ac5f9f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:09.492074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:09.562615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7206cfa-475f-4bc3-aec6-93acd5ac5f9f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:09.599873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f634eb-80af-4c1d-808d-893ed5277763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:09.600587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f634eb-80af-4c1d-808d-893ed5277763 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:09.600867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f634eb-80af-4c1d-808d-893ed5277763 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:09.601143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f634eb-80af-4c1d-808d-893ed5277763 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3/users/2e7fe446aaea41eda34c7095c3afc2a9/roles/1b09a9c0489848ada69cb56ccf36aebd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:09.603369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f634eb-80af-4c1d-808d-893ed5277763 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e424d66a95a494a86f95591ae27a0e3, user_id=2e7fe446aaea41eda34c7095c3afc2a9, role_id=1b09a9c0489848ada69cb56ccf36aebd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:09.604912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f634eb-80af-4c1d-808d-893ed5277763 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:09.725689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 116/234] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:09 2022] PUT /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3/users/2e7fe446aaea41eda34c7095c3afc2a9/roles/1b09a9c0489848ada69cb56ccf36aebd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:11.183452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327020f6-9e14-4f13-8d24-4cdff9361951 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.184904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327020f6-9e14-4f13-8d24-4cdff9361951 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.185422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327020f6-9e14-4f13-8d24-4cdff9361951 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.187246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 119/235] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:11.193050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1535d8-89b1-42a6-a78c-88d0c2a38f02 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.193874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1535d8-89b1-42a6-a78c-88d0c2a38f02 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.194351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1535d8-89b1-42a6-a78c-88d0c2a38f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.221279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4c1535d8-89b1-42a6-a78c-88d0c2a38f02 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:11.222826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4c1535d8-89b1-42a6-a78c-88d0c2a38f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:11.322880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 117/236] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:11.359186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327020f6-9e14-4f13-8d24-4cdff9361951 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:11.387879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:11.499592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327020f6-9e14-4f13-8d24-4cdff9361951 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:11.545987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dcdf1-a872-4db3-bd52-848715cb84bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:11.547020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dcdf1-a872-4db3-bd52-848715cb84bb None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.547506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dcdf1-a872-4db3-bd52-848715cb84bb None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.547980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dcdf1-a872-4db3-bd52-848715cb84bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.567672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dcdf1-a872-4db3-bd52-848715cb84bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:11.572179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ebe2-03f6-49ca-a5a9-5264e451ec36 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.572728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ebe2-03f6-49ca-a5a9-5264e451ec36 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.573214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ebe2-03f6-49ca-a5a9-5264e451ec36 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.575659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 118/237] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-459dcdf1-a872-4db3-bd52-848715cb84bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:11.579009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:11.580454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:11.581269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:11.583748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ffe49-eaf4-4b02-adc2-48a360208bd4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.584292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ffe49-eaf4-4b02-adc2-48a360208bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.584793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ffe49-eaf4-4b02-adc2-48a360208bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.589415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 120/238] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:11.596288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dcdf1-a872-4db3-bd52-848715cb84bb None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:11.615035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1a9ffe49-eaf4-4b02-adc2-48a360208bd4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:11.616205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a9ffe49-eaf4-4b02-adc2-48a360208bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:11.652736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:11.720002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 119/239] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:11.721325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2f4d1-1ec3-4cf3-ad81-6f8c4ff2e657 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.721673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2f4d1-1ec3-4cf3-ad81-6f8c4ff2e657 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.721956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2f4d1-1ec3-4cf3-ad81-6f8c4ff2e657 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.723200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 120/240] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:11.728436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8287-ff1b-48fb-817f-f4b9f4024c7a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.729152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8287-ff1b-48fb-817f-f4b9f4024c7a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.729436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d8287-ff1b-48fb-817f-f4b9f4024c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.731735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:11.751271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-698d8287-ff1b-48fb-817f-f4b9f4024c7a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:11.752430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-698d8287-ff1b-48fb-817f-f4b9f4024c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:11.769485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dcdf1-a872-4db3-bd52-848715cb84bb None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:11.811860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:11.812664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.812947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.813219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.814292 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:11.814861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:11.816444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:11.830184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 121/241] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:11.831745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:11.842780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 121/242] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:11.852367 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d8287-ff1b-48fb-817f-f4b9f4024c7a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:11.950445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadfd72-6b9b-4849-af91-8c8f96d4ba21 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:11.958115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:11.974087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d8287-ff1b-48fb-817f-f4b9f4024c7a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:11.987101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029e1c9-af25-4314-9c99-48592520f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:11.987742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e1c9-af25-4314-9c99-48592520f9ae None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.988027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e1c9-af25-4314-9c99-48592520f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.988299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029e1c9-af25-4314-9c99-48592520f9ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.989434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029e1c9-af25-4314-9c99-48592520f9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:11.990959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029e1c9-af25-4314-9c99-48592520f9ae None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:11.997278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 122/243] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:11.997278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b3db-96e1-4c6e-865d-57834c182c64 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:11.997278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b3db-96e1-4c6e-865d-57834c182c64 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:11.997278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886b3db-96e1-4c6e-865d-57834c182c64 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:11.997278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 123/244] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:11.997278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886b3db-96e1-4c6e-865d-57834c182c64 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:12.010172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:12.021158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9763e3-6d0f-454f-ad71-ebfae36e1834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:12.021794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9763e3-6d0f-454f-ad71-ebfae36e1834 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.022070 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9763e3-6d0f-454f-ad71-ebfae36e1834 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.022337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9763e3-6d0f-454f-ad71-ebfae36e1834 None admin] PATH_INFO: `/v3/users/1d18ab83d9ab4e67b65de585bc61da07` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.039046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9763e3-6d0f-454f-ad71-ebfae36e1834 None admin] RBAC: Authorizing `identity:get_user(user_id=1d18ab83d9ab4e67b65de585bc61da07)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:12.040512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9763e3-6d0f-454f-ad71-ebfae36e1834 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:12.042223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 122/245] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:11 2022] GET /identity/v3/users/1d18ab83d9ab4e67b65de585bc61da07 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:12.042881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9763e3-6d0f-454f-ad71-ebfae36e1834 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:12.112370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886b3db-96e1-4c6e-865d-57834c182c64 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:12.146235 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9763e3-6d0f-454f-ad71-ebfae36e1834 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:12.147559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cb5ec-3643-47b4-a18e-801909fd5929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:12.148383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb5ec-3643-47b4-a18e-801909fd5929 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.148808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb5ec-3643-47b4-a18e-801909fd5929 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.149236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb5ec-3643-47b4-a18e-801909fd5929 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.161852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310cb5ec-3643-47b4-a18e-801909fd5929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-310cb5ec-3643-47b4-a18e-801909fd5929 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:12.168131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:12.169134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 124/246] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:12.174964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499977-26bf-4c94-90d1-73e2269146b7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.175739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499977-26bf-4c94-90d1-73e2269146b7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.175739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499977-26bf-4c94-90d1-73e2269146b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.183125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3938fa-476a-4e4d-801e-6f5306309dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:12.184766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3938fa-476a-4e4d-801e-6f5306309dea None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.184766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3938fa-476a-4e4d-801e-6f5306309dea None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.184766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3938fa-476a-4e4d-801e-6f5306309dea None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.185417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3938fa-476a-4e4d-801e-6f5306309dea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:12.186897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3938fa-476a-4e4d-801e-6f5306309dea None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:12.192955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2a499977-26bf-4c94-90d1-73e2269146b7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:12.194193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2a499977-26bf-4c94-90d1-73e2269146b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:12.257600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:12.268452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 125/247] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:12.268452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499977-26bf-4c94-90d1-73e2269146b7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:12.288688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:12.293538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 123/248] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:12 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:12.300372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3938fa-476a-4e4d-801e-6f5306309dea None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:12.404240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499977-26bf-4c94-90d1-73e2269146b7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:12.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3938fa-476a-4e4d-801e-6f5306309dea None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:12.453276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3819a-5142-4545-ab1f-1b9715b80ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:12.454173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3819a-5142-4545-ab1f-1b9715b80ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.454906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3819a-5142-4545-ab1f-1b9715b80ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.455186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3819a-5142-4545-ab1f-1b9715b80ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.459593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:12.460276 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.460597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.460873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.461558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:12.461864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:12.463259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:12.476935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 124/249] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:12.477863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:12.537801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:12.540264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3819a-5142-4545-ab1f-1b9715b80ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:12.541784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3819a-5142-4545-ab1f-1b9715b80ae5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:12.556028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:12.603035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b8578-c6f8-47be-8032-c73ccf451a7d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:12.647327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e9e29-91db-4232-9c88-06205e80ffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:12.648109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9e29-91db-4232-9c88-06205e80ffba None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.648509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9e29-91db-4232-9c88-06205e80ffba None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.648783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e9e29-91db-4232-9c88-06205e80ffba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.661639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 126/250] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:12.662021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e9e29-91db-4232-9c88-06205e80ffba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:12.662495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3819a-5142-4545-ab1f-1b9715b80ae5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-202e9e29-91db-4232-9c88-06205e80ffba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:12.669326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:12.670271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:12.671098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 125/251] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:12.672559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d14e3-8d67-4a62-ab2c-e58ae22e8d6c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.672559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d14e3-8d67-4a62-ab2c-e58ae22e8d6c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.673909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d14e3-8d67-4a62-ab2c-e58ae22e8d6c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.674922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 126/252] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:12.675814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d14e3-8d67-4a62-ab2c-e58ae22e8d6c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:12.778292 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:12.782320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3819a-5142-4545-ab1f-1b9715b80ae5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:12.806776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d14e3-8d67-4a62-ab2c-e58ae22e8d6c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:12.834494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd64d-d3e2-4da6-80c5-420597afd9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:12.835271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd64d-d3e2-4da6-80c5-420597afd9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.835683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd64d-d3e2-4da6-80c5-420597afd9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.835954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd64d-d3e2-4da6-80c5-420597afd9d6 None admin] PATH_INFO: `/v3/users/f3998425b98447779184bba8e684a34f` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.836765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:12.838669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd64d-d3e2-4da6-80c5-420597afd9d6 None admin] RBAC: Authorizing `identity:get_user(user_id=f3998425b98447779184bba8e684a34f)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:12.840844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd64d-d3e2-4da6-80c5-420597afd9d6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:12.843624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 127/253] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:12 2022] GET /identity/v3/users/f3998425b98447779184bba8e684a34f => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:12.844586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd64d-d3e2-4da6-80c5-420597afd9d6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:12.850903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c891d-b0da-403d-8d8e-bf4d50d1c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:12.851752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c891d-b0da-403d-8d8e-bf4d50d1c75d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.852193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c891d-b0da-403d-8d8e-bf4d50d1c75d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.852637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c891d-b0da-403d-8d8e-bf4d50d1c75d None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.853925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c891d-b0da-403d-8d8e-bf4d50d1c75d None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:12.856555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c891d-b0da-403d-8d8e-bf4d50d1c75d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:12.863755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 127/254] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:12 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:12.865359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad6f24-c718-43f3-a61c-424ccb410e3f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:12.865889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad6f24-c718-43f3-a61c-424ccb410e3f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:12.866329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad6f24-c718-43f3-a61c-424ccb410e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:12.887395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-58ad6f24-c718-43f3-a61c-424ccb410e3f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:12.889362 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-58ad6f24-c718-43f3-a61c-424ccb410e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:12.972455 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 128/255] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:12.972848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd64d-d3e2-4da6-80c5-420597afd9d6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:12.973818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad6f24-c718-43f3-a61c-424ccb410e3f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.017730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:13.018597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:13.019027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:13.019444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:13.020338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:13.020816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:13.022357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:13.031756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 128/256] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:13.033271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.070173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:13.093970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad6f24-c718-43f3-a61c-424ccb410e3f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:13.119220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:13.135360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe5ccf-7658-4db5-abcf-bea9100aa85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:13.136291 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5ccf-7658-4db5-abcf-bea9100aa85f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:13.136999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5ccf-7658-4db5-abcf-bea9100aa85f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:13.137867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe5ccf-7658-4db5-abcf-bea9100aa85f None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:13.139228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe5ccf-7658-4db5-abcf-bea9100aa85f None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:13.141080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe5ccf-7658-4db5-abcf-bea9100aa85f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:13.143040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 129/257] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:12 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:13.144199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe5ccf-7658-4db5-abcf-bea9100aa85f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.165539 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04647853-e053-485a-8266-a7a9e6b73eb0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:13.209182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:13.209847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:13.210068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:13.210341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:13.211335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] RBAC: Adding query filter params (role.id=d820a202bc2440d7b1f2a7190d4cae7c, scope.project.id=8e424d66a95a494a86f95591ae27a0e3, user.id=1d18ab83d9ab4e67b65de585bc61da07) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:13.211650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:13.213818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:13.227311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 129/258] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:13 2022] GET /identity/v3/role_assignments?user.id=1d18ab83d9ab4e67b65de585bc61da07&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=d820a202bc2440d7b1f2a7190d4cae7c => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:13.227311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.310915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe5ccf-7658-4db5-abcf-bea9100aa85f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:13.377643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe938-d16d-46ee-b6a2-b5d24372666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:13.377643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe938-d16d-46ee-b6a2-b5d24372666f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:13.377643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe938-d16d-46ee-b6a2-b5d24372666f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:13.377643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfe938-d16d-46ee-b6a2-b5d24372666f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:13.384181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfe938-d16d-46ee-b6a2-b5d24372666f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-00bfe938-d16d-46ee-b6a2-b5d24372666f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:13.388694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:13.389910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 130/259] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:13.390942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe938-d16d-46ee-b6a2-b5d24372666f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.401324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:13.417117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390646-735e-4c4d-9826-9a36de36679d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:13.461746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:13.488266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a04d2a-ee51-447b-a465-47b008968048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:13.488949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a04d2a-ee51-447b-a465-47b008968048 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:13.489277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a04d2a-ee51-447b-a465-47b008968048 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:13.489602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a04d2a-ee51-447b-a465-47b008968048 None admin] PATH_INFO: `/v3/users/2e7fe446aaea41eda34c7095c3afc2a9` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:13.491188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a04d2a-ee51-447b-a465-47b008968048 None admin] RBAC: Authorizing `identity:get_user(user_id=2e7fe446aaea41eda34c7095c3afc2a9)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:13.492153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a04d2a-ee51-447b-a465-47b008968048 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:13.494487 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 130/260] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:13 2022] GET /identity/v3/users/2e7fe446aaea41eda34c7095c3afc2a9 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:13.495329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a04d2a-ee51-447b-a465-47b008968048 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.530015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfe938-d16d-46ee-b6a2-b5d24372666f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:13.576038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98be6a-86c6-4e05-a0f0-b60980d71fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:13.576945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98be6a-86c6-4e05-a0f0-b60980d71fcf None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:13.577244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98be6a-86c6-4e05-a0f0-b60980d71fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:13.577560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98be6a-86c6-4e05-a0f0-b60980d71fcf None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3/users/f3998425b98447779184bba8e684a34f/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:13.580037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98be6a-86c6-4e05-a0f0-b60980d71fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=8e424d66a95a494a86f95591ae27a0e3, user_id=f3998425b98447779184bba8e684a34f, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:13.581511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98be6a-86c6-4e05-a0f0-b60980d71fcf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:13.618222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a04d2a-ee51-447b-a465-47b008968048 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:13.658854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:13.659556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:13.659847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:13.660323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:13.661015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:13.661322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:13.662722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:13.672019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 131/261] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:13 2022] PUT /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3/users/f3998425b98447779184bba8e684a34f/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:13.672957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98be6a-86c6-4e05-a0f0-b60980d71fcf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.675807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 131/262] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:13.679971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.733674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:13.820377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaa878-e37b-4adc-adfb-72e80ac6c189 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:13.859964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142787a4-27b3-41cf-93a1-250703e26de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:13.860667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142787a4-27b3-41cf-93a1-250703e26de8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:13.860948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142787a4-27b3-41cf-93a1-250703e26de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:13.861283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142787a4-27b3-41cf-93a1-250703e26de8 None admin] PATH_INFO: `/v3/users/2e7fe446aaea41eda34c7095c3afc2a9` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:13.862493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142787a4-27b3-41cf-93a1-250703e26de8 None admin] RBAC: Authorizing `identity:get_user(user_id=2e7fe446aaea41eda34c7095c3afc2a9)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:13.863958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142787a4-27b3-41cf-93a1-250703e26de8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:13.865594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 132/263] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:13 2022] GET /identity/v3/users/2e7fe446aaea41eda34c7095c3afc2a9 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:13.872331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142787a4-27b3-41cf-93a1-250703e26de8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:13.958411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98be6a-86c6-4e05-a0f0-b60980d71fcf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:13.974026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:13.978334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:13.984171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142787a4-27b3-41cf-93a1-250703e26de8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:14.035156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d88f-7eaf-48ab-a5a7-3c4326a59d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:14.035775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d88f-7eaf-48ab-a5a7-3c4326a59d24 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:14.036053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d88f-7eaf-48ab-a5a7-3c4326a59d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:14.036337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d88f-7eaf-48ab-a5a7-3c4326a59d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:14.045073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef7f2-0597-4071-b56a-d32d4d1bce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:14.045708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef7f2-0597-4071-b56a-d32d4d1bce5f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:14.045982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef7f2-0597-4071-b56a-d32d4d1bce5f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:14.046266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef7f2-0597-4071-b56a-d32d4d1bce5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:14.119726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cef7f2-0597-4071-b56a-d32d4d1bce5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:14.121929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cef7f2-0597-4071-b56a-d32d4d1bce5f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:14.193434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d88f-7eaf-48ab-a5a7-3c4326a59d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:14.194912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d88f-7eaf-48ab-a5a7-3c4326a59d24 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:14.225836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 132/264] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:14.231353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef7f2-0597-4071-b56a-d32d4d1bce5f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:14.245982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:14.341355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef7f2-0597-4071-b56a-d32d4d1bce5f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:14.358759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:14.380902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279d1dc-511a-4b78-94c1-1eaab18e7e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:14.381545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d1dc-511a-4b78-94c1-1eaab18e7e4a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:14.382016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d1dc-511a-4b78-94c1-1eaab18e7e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:14.382288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279d1dc-511a-4b78-94c1-1eaab18e7e4a None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:14.383524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279d1dc-511a-4b78-94c1-1eaab18e7e4a None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:14.385008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279d1dc-511a-4b78-94c1-1eaab18e7e4a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:14.387838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 133/265] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:14 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:14.393685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279d1dc-511a-4b78-94c1-1eaab18e7e4a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:14.401923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 133/266] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 11:04:14.409261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d88f-7eaf-48ab-a5a7-3c4326a59d24 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:14.477546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:14.498525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279d1dc-511a-4b78-94c1-1eaab18e7e4a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:14.549047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:14.549681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:14.549962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:14.550235 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:14.550981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=8e424d66a95a494a86f95591ae27a0e3, user.id=2e7fe446aaea41eda34c7095c3afc2a9) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:14.551283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:14.552741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:14.559127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 134/267] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:14 2022] GET /identity/v3/role_assignments?user.id=2e7fe446aaea41eda34c7095c3afc2a9&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:14.571603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d88f-7eaf-48ab-a5a7-3c4326a59d24 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:14.626461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2909b3c-7271-4c8f-a300-1d5bbb55962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:14.627115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909b3c-7271-4c8f-a300-1d5bbb55962a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:14.627395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909b3c-7271-4c8f-a300-1d5bbb55962a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:14.627666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909b3c-7271-4c8f-a300-1d5bbb55962a None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:14.629035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2909b3c-7271-4c8f-a300-1d5bbb55962a None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:14.630491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2909b3c-7271-4c8f-a300-1d5bbb55962a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:14.632350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 134/268] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:14 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:14.638450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:14.781142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40e39d-66e3-431b-9991-7f6fedbcd75e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:14.817346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c2c76-8a62-4f34-a92a-81a969eb2514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:14.817962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2c76-8a62-4f34-a92a-81a969eb2514 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:14.818238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2c76-8a62-4f34-a92a-81a969eb2514 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:14.818506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c2c76-8a62-4f34-a92a-81a969eb2514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:14.819254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c2c76-8a62-4f34-a92a-81a969eb2514 None admin] RBAC: Adding query filter params (role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=8e424d66a95a494a86f95591ae27a0e3, user.id=2e7fe446aaea41eda34c7095c3afc2a9) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:14.819554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c2c76-8a62-4f34-a92a-81a969eb2514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:14.821048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c2c76-8a62-4f34-a92a-81a969eb2514 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:14.828091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 135/269] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:14 2022] GET /identity/v3/role_assignments?user.id=2e7fe446aaea41eda34c7095c3afc2a9&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:14.902379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1a44-8f27-4a56-96a6-8031e8f212a9 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:14.902865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1a44-8f27-4a56-96a6-8031e8f212a9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:14.902976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1a44-8f27-4a56-96a6-8031e8f212a9 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:14.904438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 135/270] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:14.919397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474529a1-b971-4395-895e-f31ce61cef7b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:14.920013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474529a1-b971-4395-895e-f31ce61cef7b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:14.920533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474529a1-b971-4395-895e-f31ce61cef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:14.930507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:14.943765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-474529a1-b971-4395-895e-f31ce61cef7b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:14.945477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-474529a1-b971-4395-895e-f31ce61cef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:15.034361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 136/271] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:15.070118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a1a44-8f27-4a56-96a6-8031e8f212a9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:15.156700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:15.203491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a1a44-8f27-4a56-96a6-8031e8f212a9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:15.243916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f8e2-1528-4f92-ad23-5e91085d2f89 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.244217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f8e2-1528-4f92-ad23-5e91085d2f89 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.244497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89f8e2-1528-4f92-ad23-5e91085d2f89 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.245913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 137/272] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:15.246100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d099-064e-494a-a7f8-3c09d662a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:15.247275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d099-064e-494a-a7f8-3c09d662a41c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.247738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d099-064e-494a-a7f8-3c09d662a41c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.248012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d099-064e-494a-a7f8-3c09d662a41c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.259603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207e16-77be-413f-b823-756ab9e5b1ee None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.259884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207e16-77be-413f-b823-756ab9e5b1ee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.259999 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d099-064e-494a-a7f8-3c09d662a41c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:15.260154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207e16-77be-413f-b823-756ab9e5b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-a6b3d099-064e-494a-a7f8-3c09d662a41c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:15.265633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:15.266512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:15.267322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 136/273] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:15.274358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d099-064e-494a-a7f8-3c09d662a41c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:15.283142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0d207e16-77be-413f-b823-756ab9e5b1ee None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:15.284478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0d207e16-77be-413f-b823-756ab9e5b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:15.379353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 138/274] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:15.401553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d099-064e-494a-a7f8-3c09d662a41c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:15.407001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d207e16-77be-413f-b823-756ab9e5b1ee None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:15.425876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:15.442012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:15.442632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.442906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.443188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.443861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:15.444165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:15.446642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:15.462665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 137/275] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:15.463722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:15.484984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:15.539656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d207e16-77be-413f-b823-756ab9e5b1ee None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:15.579716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ee45-485b-470a-bbcd-935b936a0b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:15.580811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ee45-485b-470a-bbcd-935b936a0b05 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.581310 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ee45-485b-470a-bbcd-935b936a0b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.581798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ee45-485b-470a-bbcd-935b936a0b05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.583090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9ee45-485b-470a-bbcd-935b936a0b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:15.584756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9ee45-485b-470a-bbcd-935b936a0b05 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:15.586512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 139/276] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:15.591768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8291c4-19ba-4c3f-9fed-732a2f59e2f5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:15.592868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ee45-485b-470a-bbcd-935b936a0b05 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:15.632701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8848acb-0614-4193-9b9f-048844417e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:15.633330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848acb-0614-4193-9b9f-048844417e42 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.633616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848acb-0614-4193-9b9f-048844417e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.633891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8848acb-0614-4193-9b9f-048844417e42 None admin] PATH_INFO: `/v3/users/e4047c71615b47d38d5531234111be1b` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.651344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8848acb-0614-4193-9b9f-048844417e42 None admin] RBAC: Authorizing `identity:get_user(user_id=e4047c71615b47d38d5531234111be1b)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:15.653546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8848acb-0614-4193-9b9f-048844417e42 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:15.656362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 138/277] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:15 2022] GET /identity/v3/users/e4047c71615b47d38d5531234111be1b => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:15.662091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8848acb-0614-4193-9b9f-048844417e42 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:15.710029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:15.720212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ee45-485b-470a-bbcd-935b936a0b05 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:15.757058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:15.763481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336058a-9ffe-4458-97f4-b5a6d67e318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:15.764163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336058a-9ffe-4458-97f4-b5a6d67e318c None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.764486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336058a-9ffe-4458-97f4-b5a6d67e318c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.764760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336058a-9ffe-4458-97f4-b5a6d67e318c None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.765407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336058a-9ffe-4458-97f4-b5a6d67e318c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:15.767012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336058a-9ffe-4458-97f4-b5a6d67e318c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:15.777044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8848acb-0614-4193-9b9f-048844417e42 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:15.826311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fc99-4a18-43d2-bdb3-6c55068f42be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:15.826980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fc99-4a18-43d2-bdb3-6c55068f42be None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.827333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fc99-4a18-43d2-bdb3-6c55068f42be None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.827778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fc99-4a18-43d2-bdb3-6c55068f42be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.828635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fc99-4a18-43d2-bdb3-6c55068f42be None admin] RBAC: Adding query filter params (role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, user.id=e4047c71615b47d38d5531234111be1b, scope.system=all) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:15.829015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fc99-4a18-43d2-bdb3-6c55068f42be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:15.830657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fc99-4a18-43d2-bdb3-6c55068f42be None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:15.840511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 139/278] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 10 11:04:15 2022] GET /identity/v3/role_assignments?user.id=e4047c71615b47d38d5531234111be1b&scope.system=all&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:15.846851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 140/279] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:15 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:15.961348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06a46-bcbd-45f1-a7ab-e1d955b2075f None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.961724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06a46-bcbd-45f1-a7ab-e1d955b2075f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.961907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06a46-bcbd-45f1-a7ab-e1d955b2075f None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.963252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 140/280] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:15.969885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e9ac-5847-4b65-a36b-6b5eb9491c19 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:15.970518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e9ac-5847-4b65-a36b-6b5eb9491c19 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:15.971023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e9ac-5847-4b65-a36b-6b5eb9491c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:15.990809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2af5e9ac-5847-4b65-a36b-6b5eb9491c19 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:15.992441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2af5e9ac-5847-4b65-a36b-6b5eb9491c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:16.070865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 141/281] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:16.093041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede06a46-bcbd-45f1-a7ab-e1d955b2075f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:16.208759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede06a46-bcbd-45f1-a7ab-e1d955b2075f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:16.211512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:16.249176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4874e3-19d7-4ea6-b2f9-ce0c9f1566cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:16.249821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4874e3-19d7-4ea6-b2f9-ce0c9f1566cb None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:16.250096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4874e3-19d7-4ea6-b2f9-ce0c9f1566cb None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:16.250369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4874e3-19d7-4ea6-b2f9-ce0c9f1566cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:16.262910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4874e3-19d7-4ea6-b2f9-ce0c9f1566cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-2b4874e3-19d7-4ea6-b2f9-ce0c9f1566cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:16.267645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:16.268567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:16.269791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 141/282] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:16.274886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e9ac-5847-4b65-a36b-6b5eb9491c19 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:16.393595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e9ac-5847-4b65-a36b-6b5eb9491c19 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:16.419605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:16.429311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11fc18-4e67-43ea-82e2-3489eea02e2b None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:16.429795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11fc18-4e67-43ea-82e2-3489eea02e2b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:16.430186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11fc18-4e67-43ea-82e2-3489eea02e2b None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:16.431783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 142/283] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:16.437427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc09b0-1cef-458b-b142-3cc51612fbf2 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:16.437712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc09b0-1cef-458b-b142-3cc51612fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:16.438044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc09b0-1cef-458b-b142-3cc51612fbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:16.456053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:16.456826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:16.457106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:16.457427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:16.458109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:16.458475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:16.459964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:16.466085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-30cc09b0-1cef-458b-b142-3cc51612fbf2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:16.467287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-30cc09b0-1cef-458b-b142-3cc51612fbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:16.469599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 142/284] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:16.475211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:16.602710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 143/285] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:16.628771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e8c11-0783-4fd9-b051-0eff9ab60d04 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:16.649785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc09b0-1cef-458b-b142-3cc51612fbf2 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:16.686684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1fd20-36dd-41d7-81b1-79d21cf4c706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:16.687325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1fd20-36dd-41d7-81b1-79d21cf4c706 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:16.687600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1fd20-36dd-41d7-81b1-79d21cf4c706 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:16.687868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1fd20-36dd-41d7-81b1-79d21cf4c706 None admin] PATH_INFO: `/v3/users/1d18ab83d9ab4e67b65de585bc61da07` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:16.690133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1fd20-36dd-41d7-81b1-79d21cf4c706 None admin] RBAC: Authorizing `identity:get_user(user_id=1d18ab83d9ab4e67b65de585bc61da07)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:16.691564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1fd20-36dd-41d7-81b1-79d21cf4c706 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:16.693919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 143/286] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:16 2022] GET /identity/v3/users/1d18ab83d9ab4e67b65de585bc61da07 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:16.700594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1fd20-36dd-41d7-81b1-79d21cf4c706 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:16.752713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:16.806150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1fd20-36dd-41d7-81b1-79d21cf4c706 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:16.826713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:16.837112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc09b0-1cef-458b-b142-3cc51612fbf2 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:16.843866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124854ac-aaa9-4389-bc0a-b4e5005d5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:16.844705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124854ac-aaa9-4389-bc0a-b4e5005d5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:16.845146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124854ac-aaa9-4389-bc0a-b4e5005d5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:16.845559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124854ac-aaa9-4389-bc0a-b4e5005d5cd6 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:16.846810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124854ac-aaa9-4389-bc0a-b4e5005d5cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:16.848431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124854ac-aaa9-4389-bc0a-b4e5005d5cd6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:16.855292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 144/287] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:16 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:16.864106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124854ac-aaa9-4389-bc0a-b4e5005d5cd6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:16.913293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e613-8a7d-42f7-81ed-0cf8b2c987bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:16.913859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e613-8a7d-42f7-81ed-0cf8b2c987bd None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:16.914142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e613-8a7d-42f7-81ed-0cf8b2c987bd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:16.914414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e613-8a7d-42f7-81ed-0cf8b2c987bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:16.937264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54e613-8a7d-42f7-81ed-0cf8b2c987bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-0a54e613-8a7d-42f7-81ed-0cf8b2c987bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:16.942079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:16.943004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:16.943816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 144/288] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:16.949556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e613-8a7d-42f7-81ed-0cf8b2c987bd None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:16.976959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124854ac-aaa9-4389-bc0a-b4e5005d5cd6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:16.995200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:17.016933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7724ec-a56f-4d24-a02f-2a1163520ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:17.018014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7724ec-a56f-4d24-a02f-2a1163520ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:17.018524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7724ec-a56f-4d24-a02f-2a1163520ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:17.018990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7724ec-a56f-4d24-a02f-2a1163520ee5 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3/users/1d18ab83d9ab4e67b65de585bc61da07/roles/d820a202bc2440d7b1f2a7190d4cae7c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:17.021136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7724ec-a56f-4d24-a02f-2a1163520ee5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e424d66a95a494a86f95591ae27a0e3, user_id=1d18ab83d9ab4e67b65de585bc61da07, role_id=d820a202bc2440d7b1f2a7190d4cae7c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:17.022821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7724ec-a56f-4d24-a02f-2a1163520ee5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:17.094580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e613-8a7d-42f7-81ed-0cf8b2c987bd None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:17.103465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 145/289] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:16 2022] PUT /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3/users/1d18ab83d9ab4e67b65de585bc61da07/roles/d820a202bc2440d7b1f2a7190d4cae7c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:17.142257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:17.143328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:17.143835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:17.144301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:17.145217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:17.145775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:17.147521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:17.158978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 145/290] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:17.164578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7724ec-a56f-4d24-a02f-2a1163520ee5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:17.290735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7724ec-a56f-4d24-a02f-2a1163520ee5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:17.336160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fe04-e3e3-4bc0-b07e-2c0b1835d08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:17.337242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fe04-e3e3-4bc0-b07e-2c0b1835d08f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:17.337788 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fe04-e3e3-4bc0-b07e-2c0b1835d08f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:17.338254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fe04-e3e3-4bc0-b07e-2c0b1835d08f None admin] PATH_INFO: `/v3/users/f3998425b98447779184bba8e684a34f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:17.339730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2fe04-e3e3-4bc0-b07e-2c0b1835d08f None admin] RBAC: Authorizing `identity:get_user(user_id=f3998425b98447779184bba8e684a34f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:17.341389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2fe04-e3e3-4bc0-b07e-2c0b1835d08f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:17.343149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 146/291] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:17 2022] GET /identity/v3/users/f3998425b98447779184bba8e684a34f => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:17.348882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:17.370342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:17.462981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba1e24-a6b9-4c77-aead-32625f600564 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:17.503751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc0e04-07d2-4fce-9b6a-56d916424c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:17.504683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc0e04-07d2-4fce-9b6a-56d916424c64 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:17.505138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc0e04-07d2-4fce-9b6a-56d916424c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:17.505609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc0e04-07d2-4fce-9b6a-56d916424c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:17.579408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc0e04-07d2-4fce-9b6a-56d916424c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:17.581244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc0e04-07d2-4fce-9b6a-56d916424c64 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:17.598975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:17.682143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 146/292] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:17.693284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fe04-e3e3-4bc0-b07e-2c0b1835d08f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:17.752508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:17.823623 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fe04-e3e3-4bc0-b07e-2c0b1835d08f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:17.874959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6803c-6c0c-4f06-9d7b-a1c4f89f2c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:17.875600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6803c-6c0c-4f06-9d7b-a1c4f89f2c46 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:17.875877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6803c-6c0c-4f06-9d7b-a1c4f89f2c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:17.876148 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6803c-6c0c-4f06-9d7b-a1c4f89f2c46 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:17.877288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6803c-6c0c-4f06-9d7b-a1c4f89f2c46 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:17.878716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6803c-6c0c-4f06-9d7b-a1c4f89f2c46 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:17.880346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 147/293] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:17 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:17.887025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc0e04-07d2-4fce-9b6a-56d916424c64 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:18.007206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc0e04-07d2-4fce-9b6a-56d916424c64 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:18.034087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:18.057980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b22b2f-6ea8-465f-8897-43e3a18b6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:18.058672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22b2f-6ea8-465f-8897-43e3a18b6496 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.058949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22b2f-6ea8-465f-8897-43e3a18b6496 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.059319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22b2f-6ea8-465f-8897-43e3a18b6496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.060058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22b2f-6ea8-465f-8897-43e3a18b6496 None admin] RBAC: Adding query filter params (role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=8e424d66a95a494a86f95591ae27a0e3, user.id=f3998425b98447779184bba8e684a34f) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:18.060393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22b2f-6ea8-465f-8897-43e3a18b6496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:18.061836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22b2f-6ea8-465f-8897-43e3a18b6496 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:18.075037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 147/294] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:17 2022] GET /identity/v3/role_assignments?user.id=f3998425b98447779184bba8e684a34f&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:18.226170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f602-ccf8-47a3-8d39-4e057cd78aa3 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.226542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f602-ccf8-47a3-8d39-4e057cd78aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.226721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f602-ccf8-47a3-8d39-4e057cd78aa3 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.228271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 148/295] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:18.233568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f64a59-9e3d-47d7-8d6c-0b2f3511230c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.233850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f64a59-9e3d-47d7-8d6c-0b2f3511230c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.234121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f64a59-9e3d-47d7-8d6c-0b2f3511230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.262544 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-50f64a59-9e3d-47d7-8d6c-0b2f3511230c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:18.263634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-50f64a59-9e3d-47d7-8d6c-0b2f3511230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:18.333512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 148/296] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:18.355471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f602-ccf8-47a3-8d39-4e057cd78aa3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:18.467580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f602-ccf8-47a3-8d39-4e057cd78aa3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:18.483879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:18.508427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927a673-858e-4ad7-b31c-447ed6118b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:18.509075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a673-858e-4ad7-b31c-447ed6118b89 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.509348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a673-858e-4ad7-b31c-447ed6118b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.509616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927a673-858e-4ad7-b31c-447ed6118b89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.522413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927a673-858e-4ad7-b31c-447ed6118b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7927a673-858e-4ad7-b31c-447ed6118b89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:18.527633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:18.528554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:18.529780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 149/297] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:18.535150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f64a59-9e3d-47d7-8d6c-0b2f3511230c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:18.541432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b6e68-a530-44d7-be52-e78615d14d5a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.541720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b6e68-a530-44d7-be52-e78615d14d5a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.541998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b6e68-a530-44d7-be52-e78615d14d5a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.543468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 150/298] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:18.548621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77deb-9bca-43d6-ad8c-74485d146825 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.548905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77deb-9bca-43d6-ad8c-74485d146825 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.549179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77deb-9bca-43d6-ad8c-74485d146825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.568924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a2d77deb-9bca-43d6-ad8c-74485d146825 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:18.570107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a2d77deb-9bca-43d6-ad8c-74485d146825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:18.638937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 151/299] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:18.640175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174173e8-d116-47e7-8a4d-00f0f2edb5c6 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.640479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174173e8-d116-47e7-8a4d-00f0f2edb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.640753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174173e8-d116-47e7-8a4d-00f0f2edb5c6 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.641998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 152/300] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:18.647185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b326e5-f1d0-49c0-9fa3-550a8b9325f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.647466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b326e5-f1d0-49c0-9fa3-550a8b9325f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.647732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b326e5-f1d0-49c0-9fa3-550a8b9325f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.670699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f64a59-9e3d-47d7-8d6c-0b2f3511230c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:18.670909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a4b326e5-f1d0-49c0-9fa3-550a8b9325f4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:18.672075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a4b326e5-f1d0-49c0-9fa3-550a8b9325f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:18.681873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:18.705114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:18.705720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.705996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.706262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.706916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:18.707214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:18.708656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:18.718973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 149/301] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:18.720003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:18.756329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 153/302] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:18.756329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b326e5-f1d0-49c0-9fa3-550a8b9325f4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:18.786313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:18.843953 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67131c-ee87-4eea-8421-34768069afe4 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:18.859620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b326e5-f1d0-49c0-9fa3-550a8b9325f4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:18.880766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b22f61-8620-4064-987d-354c296e56c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:18.881663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22f61-8620-4064-987d-354c296e56c0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.881663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22f61-8620-4064-987d-354c296e56c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.881913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22f61-8620-4064-987d-354c296e56c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.883088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b22f61-8620-4064-987d-354c296e56c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:18.884468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b22f61-8620-4064-987d-354c296e56c0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:18.890928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 150/303] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:18.890928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b22f61-8620-4064-987d-354c296e56c0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:18.903027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f9fc-b98b-4c50-a567-5459196ddb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:18.903663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f9fc-b98b-4c50-a567-5459196ddb46 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:18.903937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f9fc-b98b-4c50-a567-5459196ddb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:18.904204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f9fc-b98b-4c50-a567-5459196ddb46 None admin] PATH_INFO: `/v3/users/e4047c71615b47d38d5531234111be1b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:18.905366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256f9fc-b98b-4c50-a567-5459196ddb46 None admin] RBAC: Authorizing `identity:get_user(user_id=e4047c71615b47d38d5531234111be1b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:18.906794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256f9fc-b98b-4c50-a567-5459196ddb46 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:18.908848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 154/304] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:18 2022] GET /identity/v3/users/e4047c71615b47d38d5531234111be1b => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:18.909384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f9fc-b98b-4c50-a567-5459196ddb46 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:18.943875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:19.006471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b22f61-8620-4064-987d-354c296e56c0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:19.014868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:19.017844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f9fc-b98b-4c50-a567-5459196ddb46 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:19.041314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058485f-a30a-4c3f-9722-bdfeab419415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:19.041866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058485f-a30a-4c3f-9722-bdfeab419415 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:19.042148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058485f-a30a-4c3f-9722-bdfeab419415 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:19.042417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058485f-a30a-4c3f-9722-bdfeab419415 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:19.054862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c665e-89a3-486a-81e1-fd73072c902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:19.055134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058485f-a30a-4c3f-9722-bdfeab419415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:19.055480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c665e-89a3-486a-81e1-fd73072c902b None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:19.055754 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c665e-89a3-486a-81e1-fd73072c902b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:19.056027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c665e-89a3-486a-81e1-fd73072c902b None admin] PATH_INFO: `/v3/groups` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:19.056679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c665e-89a3-486a-81e1-fd73072c902b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:19.058094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c665e-89a3-486a-81e1-fd73072c902b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-7058485f-a30a-4c3f-9722-bdfeab419415 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:19.061141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:19.062012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 151/305] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:19.063172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058485f-a30a-4c3f-9722-bdfeab419415 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:19.133061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 155/306] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Aug 10 11:04:18 2022] POST /identity/v3/groups => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:19.141434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c665e-89a3-486a-81e1-fd73072c902b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:19.169415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:19.172615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058485f-a30a-4c3f-9722-bdfeab419415 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:19.213025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f401553-4e4d-413f-961e-6009a7f55568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:19.214134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401553-4e4d-413f-961e-6009a7f55568 None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:19.215363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401553-4e4d-413f-961e-6009a7f55568 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:19.215861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401553-4e4d-413f-961e-6009a7f55568 None admin] PATH_INFO: `/v3/system/users/e4047c71615b47d38d5531234111be1b/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:19.217911 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401553-4e4d-413f-961e-6009a7f55568 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e4047c71615b47d38d5531234111be1b, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:19.219611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401553-4e4d-413f-961e-6009a7f55568 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:19.262354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c665e-89a3-486a-81e1-fd73072c902b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:19.287283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 152/307] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Aug 10 11:04:19 2022] PUT /identity/v3/system/users/e4047c71615b47d38d5531234111be1b/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:19.312037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:19.313197 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:19.313749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:19.314227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:19.315178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:19.315691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:19.317470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:19.328962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 156/308] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:19.334717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f401553-4e4d-413f-961e-6009a7f55568 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:19.453980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f401553-4e4d-413f-961e-6009a7f55568 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:19.490488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa623b-70de-49d9-953e-3a96413d85ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:19.491176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa623b-70de-49d9-953e-3a96413d85ce None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:19.491460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa623b-70de-49d9-953e-3a96413d85ce None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:19.491783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa623b-70de-49d9-953e-3a96413d85ce None admin] PATH_INFO: `/v3/users/20850edc5d744c4080ddeba81da66ab1` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:19.506144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa623b-70de-49d9-953e-3a96413d85ce None admin] RBAC: Authorizing `identity:get_user(user_id=20850edc5d744c4080ddeba81da66ab1)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:19.507613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa623b-70de-49d9-953e-3a96413d85ce None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:19.509590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 153/309] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:19 2022] GET /identity/v3/users/20850edc5d744c4080ddeba81da66ab1 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:19.515403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:19.542413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:19.625761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62884ec-ab0c-4b35-8752-9f332d77d73c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:19.661834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc51386-53c0-419a-9017-a547e2fb6d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:19.662800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51386-53c0-419a-9017-a547e2fb6d0b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:19.663308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51386-53c0-419a-9017-a547e2fb6d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:19.663815 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51386-53c0-419a-9017-a547e2fb6d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:19.664781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc51386-53c0-419a-9017-a547e2fb6d0b None admin] RBAC: Adding query filter params (role.id=d820a202bc2440d7b1f2a7190d4cae7c, user.id=20850edc5d744c4080ddeba81da66ab1, scope.system=all) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:19.665292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc51386-53c0-419a-9017-a547e2fb6d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:19.666934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc51386-53c0-419a-9017-a547e2fb6d0b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:19.673627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 157/310] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 10 11:04:19 2022] GET /identity/v3/role_assignments?user.id=20850edc5d744c4080ddeba81da66ab1&scope.system=all&role.id=d820a202bc2440d7b1f2a7190d4cae7c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:19.861284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54872-62cd-4655-a1b6-74fd69b7e92d None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:19.861786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54872-62cd-4655-a1b6-74fd69b7e92d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:19.861859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd54872-62cd-4655-a1b6-74fd69b7e92d None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:19.863368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 154/311] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:19.868479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc464f-f3c4-4e67-8995-2a58c697d7ae None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:19.868875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc464f-f3c4-4e67-8995-2a58c697d7ae None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:19.869055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc464f-f3c4-4e67-8995-2a58c697d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:19.888090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c6cc464f-f3c4-4e67-8995-2a58c697d7ae None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:19.889226 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c6cc464f-f3c4-4e67-8995-2a58c697d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:19.971018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 158/312] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:19.992856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd54872-62cd-4655-a1b6-74fd69b7e92d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:20.018822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:20.100022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd54872-62cd-4655-a1b6-74fd69b7e92d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:20.134727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44a9a7-5796-436c-baf8-39195a57f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:20.135363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44a9a7-5796-436c-baf8-39195a57f496 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:20.135644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44a9a7-5796-436c-baf8-39195a57f496 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:20.135917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44a9a7-5796-436c-baf8-39195a57f496 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:20.146721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44a9a7-5796-436c-baf8-39195a57f496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-2e44a9a7-5796-436c-baf8-39195a57f496 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:20.151359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:20.152320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:20.153137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:20.156631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 155/313] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:20.158922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc464f-f3c4-4e67-8995-2a58c697d7ae None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:20.177077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:20.260377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc464f-f3c4-4e67-8995-2a58c697d7ae None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:20.301355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:20.302028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:20.302312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:20.302587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:20.303257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:20.303558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:20.304953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:20.314056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 159/314] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:20.319251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44a9a7-5796-436c-baf8-39195a57f496 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:20.405091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:20.427154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44a9a7-5796-436c-baf8-39195a57f496 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:20.462059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa4b7-72e3-48a9-baa6-624a2405307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:20.462698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa4b7-72e3-48a9-baa6-624a2405307d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:20.463015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa4b7-72e3-48a9-baa6-624a2405307d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:20.463254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa4b7-72e3-48a9-baa6-624a2405307d None admin] PATH_INFO: `/v3/users/1d18ab83d9ab4e67b65de585bc61da07` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:20.464438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa4b7-72e3-48a9-baa6-624a2405307d None admin] RBAC: Authorizing `identity:get_user(user_id=1d18ab83d9ab4e67b65de585bc61da07)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:20.465893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa4b7-72e3-48a9-baa6-624a2405307d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:20.467850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 156/315] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:20 2022] GET /identity/v3/users/1d18ab83d9ab4e67b65de585bc61da07 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:20.473370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:20.555746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:20.578311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f0b6e-2cc1-4746-b213-eabea7ecd245 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:20.611957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38cdd5-6769-4553-8685-3b2e09de2533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:20.612641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cdd5-6769-4553-8685-3b2e09de2533 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:20.612924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cdd5-6769-4553-8685-3b2e09de2533 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:20.613240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cdd5-6769-4553-8685-3b2e09de2533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:20.691234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38cdd5-6769-4553-8685-3b2e09de2533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:20.691234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38cdd5-6769-4553-8685-3b2e09de2533 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:20.761082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:20.783676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 160/316] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:20.790905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa4b7-72e3-48a9-baa6-624a2405307d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:20.904725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa4b7-72e3-48a9-baa6-624a2405307d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:20.940685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e19358-c7dd-4e27-b081-b86b872ec666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:20.941383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19358-c7dd-4e27-b081-b86b872ec666 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:20.941601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19358-c7dd-4e27-b081-b86b872ec666 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:20.941876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e19358-c7dd-4e27-b081-b86b872ec666 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:20.942990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e19358-c7dd-4e27-b081-b86b872ec666 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:20.944472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e19358-c7dd-4e27-b081-b86b872ec666 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:20.946084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 157/317] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:20 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:20.952801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38cdd5-6769-4553-8685-3b2e09de2533 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:21.054853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38cdd5-6769-4553-8685-3b2e09de2533 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:21.090949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fa1ab-f2f9-4600-9aae-c93d6a1050fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:21.091568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa1ab-f2f9-4600-9aae-c93d6a1050fa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.091849 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa1ab-f2f9-4600-9aae-c93d6a1050fa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.092122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fa1ab-f2f9-4600-9aae-c93d6a1050fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.092898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fa1ab-f2f9-4600-9aae-c93d6a1050fa None admin] RBAC: Adding query filter params (role.id=d820a202bc2440d7b1f2a7190d4cae7c, scope.project.id=8e424d66a95a494a86f95591ae27a0e3, user.id=1d18ab83d9ab4e67b65de585bc61da07) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:21.093204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fa1ab-f2f9-4600-9aae-c93d6a1050fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:21.094624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fa1ab-f2f9-4600-9aae-c93d6a1050fa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:21.100757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 161/318] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:20 2022] GET /identity/v3/role_assignments?user.id=1d18ab83d9ab4e67b65de585bc61da07&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=d820a202bc2440d7b1f2a7190d4cae7c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:21.336601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f02c-29c8-4c8a-90db-0476ded74dfc None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.336938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f02c-29c8-4c8a-90db-0476ded74dfc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.337111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613f02c-29c8-4c8a-90db-0476ded74dfc None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.338530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 158/319] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:21.343780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625daec4-1432-4acf-846d-5a4a00972ff6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.344067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625daec4-1432-4acf-846d-5a4a00972ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.344363 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625daec4-1432-4acf-846d-5a4a00972ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.346791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde01b03-9590-4e1f-8d73-b5f0afdb4bc2 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.347075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde01b03-9590-4e1f-8d73-b5f0afdb4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.347348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde01b03-9590-4e1f-8d73-b5f0afdb4bc2 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.348751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 159/320] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:21.353359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9334b-e6fd-4eaa-b3df-b079ed2013db None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.353636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9334b-e6fd-4eaa-b3df-b079ed2013db None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.353905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9334b-e6fd-4eaa-b3df-b079ed2013db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.362767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-625daec4-1432-4acf-846d-5a4a00972ff6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:21.363950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-625daec4-1432-4acf-846d-5a4a00972ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:21.372525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e1b9334b-e6fd-4eaa-b3df-b079ed2013db None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:21.373682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e1b9334b-e6fd-4eaa-b3df-b079ed2013db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:21.386913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:21.404955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:21.437670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 162/321] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:21.440359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 160/322] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:21.460227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625daec4-1432-4acf-846d-5a4a00972ff6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:21.462292 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9334b-e6fd-4eaa-b3df-b079ed2013db None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:21.568955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9334b-e6fd-4eaa-b3df-b079ed2013db None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:21.570365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625daec4-1432-4acf-846d-5a4a00972ff6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:21.604961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ddfa-358f-4ab8-9b35-b7c237a8ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:21.605994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ddfa-358f-4ab8-9b35-b7c237a8ea77 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.606094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f17f8-c541-4b1e-989f-cd8118279e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:21.606284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ddfa-358f-4ab8-9b35-b7c237a8ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.606535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ddfa-358f-4ab8-9b35-b7c237a8ea77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.606807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f17f8-c541-4b1e-989f-cd8118279e12 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.607084 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f17f8-c541-4b1e-989f-cd8118279e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.607351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f17f8-c541-4b1e-989f-cd8118279e12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.607619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8ddfa-358f-4ab8-9b35-b7c237a8ea77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:21.609130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8ddfa-358f-4ab8-9b35-b7c237a8ea77 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:21.610758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 161/323] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:21.616474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ddfa-358f-4ab8-9b35-b7c237a8ea77 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:21.617949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f17f8-c541-4b1e-989f-cd8118279e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-291f17f8-c541-4b1e-989f-cd8118279e12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:21.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:21.623843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:21.624688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 163/324] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:21.631016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f17f8-c541-4b1e-989f-cd8118279e12 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:21.637275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:21.663407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:21.726095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ddfa-358f-4ab8-9b35-b7c237a8ea77 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:21.739655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f17f8-c541-4b1e-989f-cd8118279e12 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:21.760490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed019a-8358-4d86-a3fd-ad7c03acd3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:21.761609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed019a-8358-4d86-a3fd-ad7c03acd3d3 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.761889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed019a-8358-4d86-a3fd-ad7c03acd3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.762154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed019a-8358-4d86-a3fd-ad7c03acd3d3 None admin] PATH_INFO: `/v3/groups` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.762765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed019a-8358-4d86-a3fd-ad7c03acd3d3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:21.764197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed019a-8358-4d86-a3fd-ad7c03acd3d3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:21.774961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:21.775565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.775841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.776110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.777463 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:21.777896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:21.779260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:21.787964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 164/325] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:21.793589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:21.868443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 162/326] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Aug 10 11:04:21 2022] POST /identity/v3/groups => generated 226 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:04:21.868443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b97a3-83a3-4ed5-a487-24801515b7ef None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.868443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b97a3-83a3-4ed5-a487-24801515b7ef None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.868443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b97a3-83a3-4ed5-a487-24801515b7ef None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.868443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 163/327] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:21.871576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10126c-0170-49d8-8f01-effe8183ea31 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.871861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10126c-0170-49d8-8f01-effe8183ea31 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.872136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10126c-0170-49d8-8f01-effe8183ea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.891311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-9c10126c-0170-49d8-8f01-effe8183ea31 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:21.892626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9c10126c-0170-49d8-8f01-effe8183ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:21.907325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:21.914462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e3090-7760-4f33-9e24-0bec0e680b19 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:21.952372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115de2f7-0e04-423e-8050-82737f4ea8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:21.953024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de2f7-0e04-423e-8050-82737f4ea8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:21.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de2f7-0e04-423e-8050-82737f4ea8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:21.953667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115de2f7-0e04-423e-8050-82737f4ea8d9 None admin] PATH_INFO: `/v3/users/e4047c71615b47d38d5531234111be1b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:21.954780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de2f7-0e04-423e-8050-82737f4ea8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=e4047c71615b47d38d5531234111be1b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:21.956226 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115de2f7-0e04-423e-8050-82737f4ea8d9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:21.958078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 165/328] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:21 2022] GET /identity/v3/users/e4047c71615b47d38d5531234111be1b => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:21.965584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115de2f7-0e04-423e-8050-82737f4ea8d9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:21.975578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 164/329] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:21.997312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10126c-0170-49d8-8f01-effe8183ea31 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:22.005545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:22.086887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115de2f7-0e04-423e-8050-82737f4ea8d9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:22.109058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10126c-0170-49d8-8f01-effe8183ea31 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:22.134201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:22.135060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:22.135495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:22.135770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:22.137209 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] RBAC: Adding query filter params (role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, user.id=e4047c71615b47d38d5531234111be1b, scope.system=all) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:22.137518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:22.138949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:22.150688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8b6a3-af30-49cc-89d7-72e850b781db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:22.152102 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8b6a3-af30-49cc-89d7-72e850b781db None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:22.152621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8b6a3-af30-49cc-89d7-72e850b781db None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:22.153268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8b6a3-af30-49cc-89d7-72e850b781db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:22.154134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 166/330] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 10 11:04:21 2022] GET /identity/v3/role_assignments?user.id=e4047c71615b47d38d5531234111be1b&scope.system=all&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:22.171434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8b6a3-af30-49cc-89d7-72e850b781db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-ffe8b6a3-af30-49cc-89d7-72e850b781db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:22.176965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:22.178127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:22.179119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:22.181403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 165/331] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:22.188180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:22.219453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:22.317928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f7e86-cad6-4efd-9edd-1f4dc478adef None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:22.357754 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:22.358673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:22.359131 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:22.359578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:22.360492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:22.360970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:22.362505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:22.371880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 167/332] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:22.377977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8b6a3-af30-49cc-89d7-72e850b781db None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:22.538890 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:22.576129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8b6a3-af30-49cc-89d7-72e850b781db None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:22.621133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b398613-6686-49a9-bcc6-e59f03d1cb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:22.621894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398613-6686-49a9-bcc6-e59f03d1cb5b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:22.622180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398613-6686-49a9-bcc6-e59f03d1cb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:22.622451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398613-6686-49a9-bcc6-e59f03d1cb5b None admin] PATH_INFO: `/v3/users/20850edc5d744c4080ddeba81da66ab1` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:22.623696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b398613-6686-49a9-bcc6-e59f03d1cb5b None admin] RBAC: Authorizing `identity:get_user(user_id=20850edc5d744c4080ddeba81da66ab1)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:22.625202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b398613-6686-49a9-bcc6-e59f03d1cb5b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:22.627103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 166/333] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:22 2022] GET /identity/v3/users/20850edc5d744c4080ddeba81da66ab1 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:22.632458 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:22.734688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:22.756140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccf6ad-e997-475b-8370-37f48e743d16 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:22.795683 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc829c-ea36-4aad-aee9-029743414e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:22.796267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc829c-ea36-4aad-aee9-029743414e1b None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:22.796583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc829c-ea36-4aad-aee9-029743414e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:22.796863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc829c-ea36-4aad-aee9-029743414e1b None admin] PATH_INFO: `/v3/system/users/20850edc5d744c4080ddeba81da66ab1/roles/d820a202bc2440d7b1f2a7190d4cae7c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:22.798281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc829c-ea36-4aad-aee9-029743414e1b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=20850edc5d744c4080ddeba81da66ab1, role_id=d820a202bc2440d7b1f2a7190d4cae7c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:22.799660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc829c-ea36-4aad-aee9-029743414e1b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:22.875319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 168/334] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Aug 10 11:04:22 2022] PUT /identity/v3/system/users/20850edc5d744c4080ddeba81da66ab1/roles/d820a202bc2440d7b1f2a7190d4cae7c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:24.381653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ece2-5f21-4867-8fea-c3ababb7ca30 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:24.382181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ece2-5f21-4867-8fea-c3ababb7ca30 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:24.382496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ece2-5f21-4867-8fea-c3ababb7ca30 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:24.384205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 167/335] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:24.390059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b2eb-f121-45c5-a172-25b69c73f04f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:24.390519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b2eb-f121-45c5-a172-25b69c73f04f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:24.390620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b2eb-f121-45c5-a172-25b69c73f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:24.393876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aed75-70e5-4f82-b463-5464135acc52 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:24.394165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aed75-70e5-4f82-b463-5464135acc52 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:24.394444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aed75-70e5-4f82-b463-5464135acc52 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:24.396108 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 168/336] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:24.400897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09738102-1364-4928-9911-7f121504528a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:24.401181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09738102-1364-4928-9911-7f121504528a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:24.401460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09738102-1364-4928-9911-7f121504528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:24.439302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-09738102-1364-4928-9911-7f121504528a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:24.440602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-09738102-1364-4928-9911-7f121504528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:24.443657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5753b2eb-f121-45c5-a172-25b69c73f04f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:24.444858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5753b2eb-f121-45c5-a172-25b69c73f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:24.590162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 169/337] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:24.605436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 169/338] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:24.626437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09738102-1364-4928-9911-7f121504528a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:24.644607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753b2eb-f121-45c5-a172-25b69c73f04f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:24.728713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:24.760779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:24.780293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09738102-1364-4928-9911-7f121504528a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:24.795683 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753b2eb-f121-45c5-a172-25b69c73f04f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:24.842940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0c9e0-d17f-482b-a0ef-cabe7d822d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:24.843601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0c9e0-d17f-482b-a0ef-cabe7d822d6a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:24.843880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0c9e0-d17f-482b-a0ef-cabe7d822d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:24.844159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0c9e0-d17f-482b-a0ef-cabe7d822d6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:24.857974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83476fe-343d-4050-ade5-19e8ad5db27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:24.858689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83476fe-343d-4050-ade5-19e8ad5db27e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:24.858974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83476fe-343d-4050-ade5-19e8ad5db27e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:24.859247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83476fe-343d-4050-ade5-19e8ad5db27e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:24.859347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0c9e0-d17f-482b-a0ef-cabe7d822d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-dba0c9e0-d17f-482b-a0ef-cabe7d822d6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:24.864553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:24.865421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:24.866209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 170/339] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:24.871810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0c9e0-d17f-482b-a0ef-cabe7d822d6a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:24.876407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83476fe-343d-4050-ade5-19e8ad5db27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c83476fe-343d-4050-ade5-19e8ad5db27e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:24.881502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:24.883519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:24.885434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:24.891027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 170/340] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:24.891027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83476fe-343d-4050-ade5-19e8ad5db27e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:25.018969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83476fe-343d-4050-ade5-19e8ad5db27e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.019265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0c9e0-d17f-482b-a0ef-cabe7d822d6a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.051584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:25.067983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdaee8-0e9b-4512-a2c4-89f6a29c06b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:25.068634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdaee8-0e9b-4512-a2c4-89f6a29c06b9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.068916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdaee8-0e9b-4512-a2c4-89f6a29c06b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.069191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdaee8-0e9b-4512-a2c4-89f6a29c06b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.069871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdaee8-0e9b-4512-a2c4-89f6a29c06b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:25.070171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdaee8-0e9b-4512-a2c4-89f6a29c06b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:25.071568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdaee8-0e9b-4512-a2c4-89f6a29c06b9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:25.081123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eda644-801b-4b7b-aa54-f3c7a44d8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:25.081616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 171/341] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:25.081812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eda644-801b-4b7b-aa54-f3c7a44d8cfd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.082027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eda644-801b-4b7b-aa54-f3c7a44d8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.082304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eda644-801b-4b7b-aa54-f3c7a44d8cfd None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.082846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391c63-b7f7-46a0-a201-a67ce7326a49 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.083030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eda644-801b-4b7b-aa54-f3c7a44d8cfd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:25.083184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391c63-b7f7-46a0-a201-a67ce7326a49 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.083324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eda644-801b-4b7b-aa54-f3c7a44d8cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:25.083461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391c63-b7f7-46a0-a201-a67ce7326a49 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.084697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eda644-801b-4b7b-aa54-f3c7a44d8cfd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:25.089127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 172/342] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:25.093315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:25.093693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391c63-b7f7-46a0-a201-a67ce7326a49 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:25.100963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 171/343] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:25.102230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e355f-abd0-45a2-b55e-916d32f1d8c0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.103471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e355f-abd0-45a2-b55e-916d32f1d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.104100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e355f-abd0-45a2-b55e-916d32f1d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.141018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1a5e355f-abd0-45a2-b55e-916d32f1d8c0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:25.143032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a5e355f-abd0-45a2-b55e-916d32f1d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:25.260761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 172/344] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:25.262221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e355f-abd0-45a2-b55e-916d32f1d8c0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:25.296446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391c63-b7f7-46a0-a201-a67ce7326a49 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.363270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8b5e7-8ab9-4be0-a666-5bb37ce3a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:25.363900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b5e7-8ab9-4be0-a666-5bb37ce3a18e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.364289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b5e7-8ab9-4be0-a666-5bb37ce3a18e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.364594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b5e7-8ab9-4be0-a666-5bb37ce3a18e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.389399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e355f-abd0-45a2-b55e-916d32f1d8c0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.421950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:25.427019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d250f-075a-475a-86d1-f5379ccef155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:25.427643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d250f-075a-475a-86d1-f5379ccef155 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.427921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d250f-075a-475a-86d1-f5379ccef155 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.428194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d250f-075a-475a-86d1-f5379ccef155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.475250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:25.495224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8b5e7-8ab9-4be0-a666-5bb37ce3a18e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:25.502631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8b5e7-8ab9-4be0-a666-5bb37ce3a18e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:25.503483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d250f-075a-475a-86d1-f5379ccef155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:25.504979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d250f-075a-475a-86d1-f5379ccef155 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:25.609086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 173/345] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:25.609866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d250f-075a-475a-86d1-f5379ccef155 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:25.638332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:25.649120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 173/346] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:25.650064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8b5e7-8ab9-4be0-a666-5bb37ce3a18e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:25.715809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d250f-075a-475a-86d1-f5379ccef155 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.749153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:25.752656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce11b4-cdc6-42c0-858e-edcfff50f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:25.753299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce11b4-cdc6-42c0-858e-edcfff50f435 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.753579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce11b4-cdc6-42c0-858e-edcfff50f435 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.753855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce11b4-cdc6-42c0-858e-edcfff50f435 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.765614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8b5e7-8ab9-4be0-a666-5bb37ce3a18e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.767401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce11b4-cdc6-42c0-858e-edcfff50f435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c2ce11b4-cdc6-42c0-858e-edcfff50f435 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:25.770567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:25.772721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 174/347] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:25.774656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce11b4-cdc6-42c0-858e-edcfff50f435 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:25.804687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bd3d0-86b2-4ee8-a050-84090032d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:25.805325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bd3d0-86b2-4ee8-a050-84090032d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.805604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bd3d0-86b2-4ee8-a050-84090032d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.805972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bd3d0-86b2-4ee8-a050-84090032d9f2 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.807368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bd3d0-86b2-4ee8-a050-84090032d9f2 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:25.809454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bd3d0-86b2-4ee8-a050-84090032d9f2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:25.811370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 174/348] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:25 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:25.817337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b34b-a583-491d-bdb8-17623eebfb8a None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.817624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b34b-a583-491d-bdb8-17623eebfb8a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.818024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b34b-a583-491d-bdb8-17623eebfb8a None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.820018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 175/349] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:25.820191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58b34b-a583-491d-bdb8-17623eebfb8a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:25.903341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:25.928631 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce11b4-cdc6-42c0-858e-edcfff50f435 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.953178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58b34b-a583-491d-bdb8-17623eebfb8a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:25.976298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a5fed-56ff-4daa-92c8-c71c080bc1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:25.976969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a5fed-56ff-4daa-92c8-c71c080bc1aa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:25.977251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a5fed-56ff-4daa-92c8-c71c080bc1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:25.977521 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a5fed-56ff-4daa-92c8-c71c080bc1aa None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:25.978692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a5fed-56ff-4daa-92c8-c71c080bc1aa None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:25.981640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a5fed-56ff-4daa-92c8-c71c080bc1aa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:25.983359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 175/350] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:25 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:25.984217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a5fed-56ff-4daa-92c8-c71c080bc1aa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.000695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0949e-7508-4db3-b9a3-6b9aa75364c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.001878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0949e-7508-4db3-b9a3-6b9aa75364c4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.002363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0949e-7508-4db3-b9a3-6b9aa75364c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.002812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0949e-7508-4db3-b9a3-6b9aa75364c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.003781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0949e-7508-4db3-b9a3-6b9aa75364c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:26.004260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0949e-7508-4db3-b9a3-6b9aa75364c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:26.005822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0949e-7508-4db3-b9a3-6b9aa75364c4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:26.017087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 176/351] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:26.018587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03dd3-195c-4517-a682-4277aa2dfd2d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.019036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03dd3-195c-4517-a682-4277aa2dfd2d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.019470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03dd3-195c-4517-a682-4277aa2dfd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.041607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-bce03dd3-195c-4517-a682-4277aa2dfd2d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:26.043151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-bce03dd3-195c-4517-a682-4277aa2dfd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:26.057147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.128090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a5fed-56ff-4daa-92c8-c71c080bc1aa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.128641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 177/352] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:26.129717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce03dd3-195c-4517-a682-4277aa2dfd2d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.175671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6486-3b53-4392-8080-2fb033bba5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.176374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6486-3b53-4392-8080-2fb033bba5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.176737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6486-3b53-4392-8080-2fb033bba5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.177080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6486-3b53-4392-8080-2fb033bba5a0 None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.184819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b6486-3b53-4392-8080-2fb033bba5a0 None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:26.186543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b6486-3b53-4392-8080-2fb033bba5a0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:26.192427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 176/353] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:25 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:26.193670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6486-3b53-4392-8080-2fb033bba5a0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.220752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.253015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce03dd3-195c-4517-a682-4277aa2dfd2d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.300032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c849a-4231-4df6-b700-48cbb09d5e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.301024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c849a-4231-4df6-b700-48cbb09d5e3b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.301479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c849a-4231-4df6-b700-48cbb09d5e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.301932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c849a-4231-4df6-b700-48cbb09d5e3b None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.303943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c849a-4231-4df6-b700-48cbb09d5e3b None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:26.305794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c849a-4231-4df6-b700-48cbb09d5e3b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:26.308217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 178/354] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:26 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:26.309327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c849a-4231-4df6-b700-48cbb09d5e3b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.316918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6486-3b53-4392-8080-2fb033bba5a0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.330114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.361004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbeba7-402d-4431-8383-e49efc94a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.361779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbeba7-402d-4431-8383-e49efc94a688 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.362230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbeba7-402d-4431-8383-e49efc94a688 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.362609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbeba7-402d-4431-8383-e49efc94a688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.439272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c849a-4231-4df6-b700-48cbb09d5e3b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.447214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbeba7-402d-4431-8383-e49efc94a688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:26.449284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbeba7-402d-4431-8383-e49efc94a688 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:26.472197 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.481437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cac33-1b89-4cfb-8846-55a92bd24697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.482075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cac33-1b89-4cfb-8846-55a92bd24697 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.482354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cac33-1b89-4cfb-8846-55a92bd24697 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.482621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cac33-1b89-4cfb-8846-55a92bd24697 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.498090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cac33-1b89-4cfb-8846-55a92bd24697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-343cac33-1b89-4cfb-8846-55a92bd24697 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:26.505450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:26.506351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 179/355] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:26.507147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cac33-1b89-4cfb-8846-55a92bd24697 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.560627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 177/356] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:26.561503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbeba7-402d-4431-8383-e49efc94a688 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.605932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.632392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cac33-1b89-4cfb-8846-55a92bd24697 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.676033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457ddfc-c9a7-424f-b153-6926490fedd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.676760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ddfc-c9a7-424f-b153-6926490fedd4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.676957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbeba7-402d-4431-8383-e49efc94a688 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.677056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ddfc-c9a7-424f-b153-6926490fedd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.677203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ddfc-c9a7-424f-b153-6926490fedd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.678900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ddfc-c9a7-424f-b153-6926490fedd4 None admin] RBAC: Adding query filter params (group.id=619443fcbfdc4931baf76315c1538c03, role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:26.678900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ddfc-c9a7-424f-b153-6926490fedd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:26.681838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ddfc-c9a7-424f-b153-6926490fedd4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:26.688416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 180/357] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:26 2022] GET /identity/v3/role_assignments?group.id=619443fcbfdc4931baf76315c1538c03&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:26.689066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f92731-678b-4341-87b5-c1d54646dc13 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.689692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f92731-678b-4341-87b5-c1d54646dc13 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.689692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f92731-678b-4341-87b5-c1d54646dc13 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.690892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 181/358] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:26.691785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef432-2ee7-4f07-8c34-84d3277b893a None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.692128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef432-2ee7-4f07-8c34-84d3277b893a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.693278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ef432-2ee7-4f07-8c34-84d3277b893a None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.694062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 182/359] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:26.694842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ef432-2ee7-4f07-8c34-84d3277b893a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.704474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.722895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.723904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.724743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.725190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.726098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] RBAC: Adding query filter params (group.id=619443fcbfdc4931baf76315c1538c03, role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:26.726553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:26.729488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:26.739970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 178/360] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:26 2022] GET /identity/v3/role_assignments?group.id=619443fcbfdc4931baf76315c1538c03&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:26.739970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:26.871051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ef432-2ee7-4f07-8c34-84d3277b893a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.899117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd677b67-ac64-4a13-8991-5776694def60 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:26.915370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407904b8-f87b-4975-8de8-6bfd7fd5cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.917000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407904b8-f87b-4975-8de8-6bfd7fd5cea3 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.917801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407904b8-f87b-4975-8de8-6bfd7fd5cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.918281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407904b8-f87b-4975-8de8-6bfd7fd5cea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.919347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407904b8-f87b-4975-8de8-6bfd7fd5cea3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:26.920180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407904b8-f87b-4975-8de8-6bfd7fd5cea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:26.921839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407904b8-f87b-4975-8de8-6bfd7fd5cea3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:26.931700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:26.936133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 183/361] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:26.938408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5271-77bc-45c4-87f6-ec48d86d0be8 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.938688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5271-77bc-45c4-87f6-ec48d86d0be8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.938961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5271-77bc-45c4-87f6-ec48d86d0be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.944985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155e86a-3bb5-4a49-ab91-253d7d12d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:26.944985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155e86a-3bb5-4a49-ab91-253d7d12d01d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.944985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155e86a-3bb5-4a49-ab91-253d7d12d01d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.944985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155e86a-3bb5-4a49-ab91-253d7d12d01d None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.945328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155e86a-3bb5-4a49-ab91-253d7d12d01d None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:26.945328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155e86a-3bb5-4a49-ab91-253d7d12d01d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:26.947114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 179/362] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:26 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:26.949013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d994cb-b66b-4916-9e0f-28c8262d84cb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:26.949471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d994cb-b66b-4916-9e0f-28c8262d84cb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:26.950001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d994cb-b66b-4916-9e0f-28c8262d84cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:26.963763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-641c5271-77bc-45c4-87f6-ec48d86d0be8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:26.965985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-641c5271-77bc-45c4-87f6-ec48d86d0be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:26.970469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-22d994cb-b66b-4916-9e0f-28c8262d84cb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:26.971649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-22d994cb-b66b-4916-9e0f-28c8262d84cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:27.034998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:27.052919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 184/363] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:27.054075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c5271-77bc-45c4-87f6-ec48d86d0be8 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.065909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 180/364] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:27.066778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d994cb-b66b-4916-9e0f-28c8262d84cb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.174189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c5271-77bc-45c4-87f6-ec48d86d0be8 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.203652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d994cb-b66b-4916-9e0f-28c8262d84cb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.207747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:27.213734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d048f35-ca88-4359-9ef6-25b99dd7be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.225037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048f35-ca88-4359-9ef6-25b99dd7be59 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.225037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048f35-ca88-4359-9ef6-25b99dd7be59 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.225037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048f35-ca88-4359-9ef6-25b99dd7be59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.242634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf89be3-6507-4626-9857-e00803dba69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.243540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89be3-6507-4626-9857-e00803dba69b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.244021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89be3-6507-4626-9857-e00803dba69b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.244508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89be3-6507-4626-9857-e00803dba69b None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.246042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf89be3-6507-4626-9857-e00803dba69b None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:27.247658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf89be3-6507-4626-9857-e00803dba69b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:27.249433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 181/365] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:27.251321 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf89be3-6507-4626-9857-e00803dba69b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.313286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d048f35-ca88-4359-9ef6-25b99dd7be59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:27.315714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d048f35-ca88-4359-9ef6-25b99dd7be59 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:27.324593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:27.396156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf89be3-6507-4626-9857-e00803dba69b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.432434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818d489-044b-45eb-b1be-97a66432d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.433934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d489-044b-45eb-b1be-97a66432d985 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.434323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 185/366] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:27.434661 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d489-044b-45eb-b1be-97a66432d985 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.435119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d489-044b-45eb-b1be-97a66432d985 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.435219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d048f35-ca88-4359-9ef6-25b99dd7be59 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.447058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818d489-044b-45eb-b1be-97a66432d985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b818d489-044b-45eb-b1be-97a66432d985 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:27.454020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:27.455333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:27.456126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:27.458922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 182/367] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:27.459939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818d489-044b-45eb-b1be-97a66432d985 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.475139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:27.556703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d048f35-ca88-4359-9ef6-25b99dd7be59 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.576754 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818d489-044b-45eb-b1be-97a66432d985 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.593169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:27.594270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d337d8-2e28-4c4a-ae7a-4e9852273f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.594820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d337d8-2e28-4c4a-ae7a-4e9852273f37 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.595099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d337d8-2e28-4c4a-ae7a-4e9852273f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.595367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d337d8-2e28-4c4a-ae7a-4e9852273f37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.607611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d337d8-2e28-4c4a-ae7a-4e9852273f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-35d337d8-2e28-4c4a-ae7a-4e9852273f37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:27.614806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:27.615775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:27.616600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 186/368] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:27.617252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d337d8-2e28-4c4a-ae7a-4e9852273f37 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.619723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.621158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.621633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.622112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.623067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] RBAC: Adding query filter params (group.id=619443fcbfdc4931baf76315c1538c03, role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=8e424d66a95a494a86f95591ae27a0e3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:27.623577 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:27.625237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:27.632225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 183/369] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/role_assignments?group.id=619443fcbfdc4931baf76315c1538c03&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:27.633455 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.728092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:27.737997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d337d8-2e28-4c4a-ae7a-4e9852273f37 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.755216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce59c7a-1a1e-4e50-adca-3a0374966299 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.785125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0632e7-d1e3-4220-b607-7b4f6454f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.785784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0632e7-d1e3-4220-b607-7b4f6454f903 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.786059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0632e7-d1e3-4220-b607-7b4f6454f903 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.786326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0632e7-d1e3-4220-b607-7b4f6454f903 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.787712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0632e7-d1e3-4220-b607-7b4f6454f903 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:27.789214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0632e7-d1e3-4220-b607-7b4f6454f903 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:27.791130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 187/370] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:27.792467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0632e7-d1e3-4220-b607-7b4f6454f903 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.796160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.797036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.797601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.798089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.799062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:27.799650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:27.801229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:27.810788 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 184/371] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:27.814905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.860776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:27.918170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0632e7-d1e3-4220-b607-7b4f6454f903 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.934863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b21371-de7d-4153-b0f8-0b20445ef293 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:27.956839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.957460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.957740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.958032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:27.958689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:27.958990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:27.960415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:27.969560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 188/372] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:27.970141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:27.997674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75ae9f-fc04-4880-9c47-a20d8a53aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:27.998364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75ae9f-fc04-4880-9c47-a20d8a53aecf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:27.998486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:27.998662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75ae9f-fc04-4880-9c47-a20d8a53aecf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:27.998914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75ae9f-fc04-4880-9c47-a20d8a53aecf None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.005000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75ae9f-fc04-4880-9c47-a20d8a53aecf None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.006463 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75ae9f-fc04-4880-9c47-a20d8a53aecf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.008370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 185/373] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:28.014578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75ae9f-fc04-4880-9c47-a20d8a53aecf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:28.089634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8370ac6-6fb6-4c35-9073-b4c88c8e2675 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:28.127215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb839-6e96-436e-9b1b-b90d4e0c9bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:28.127834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb839-6e96-436e-9b1b-b90d4e0c9bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:28.128111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb839-6e96-436e-9b1b-b90d4e0c9bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:28.128418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb839-6e96-436e-9b1b-b90d4e0c9bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.135459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75ae9f-fc04-4880-9c47-a20d8a53aecf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:28.148714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:28.175016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47241f23-1955-4976-8ce1-0eed8321958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:28.175667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47241f23-1955-4976-8ce1-0eed8321958f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:28.175946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47241f23-1955-4976-8ce1-0eed8321958f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:28.176218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47241f23-1955-4976-8ce1-0eed8321958f None admin] PATH_INFO: `/v3/users/20850edc5d744c4080ddeba81da66ab1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.177498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47241f23-1955-4976-8ce1-0eed8321958f None admin] RBAC: Authorizing `identity:get_user(user_id=20850edc5d744c4080ddeba81da66ab1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.178938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47241f23-1955-4976-8ce1-0eed8321958f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.180860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 186/374] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:04:28 2022] GET /identity/v3/users/20850edc5d744c4080ddeba81da66ab1 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:28.181638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47241f23-1955-4976-8ce1-0eed8321958f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:28.214357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bb839-6e96-436e-9b1b-b90d4e0c9bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.216009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bb839-6e96-436e-9b1b-b90d4e0c9bf5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.238570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:28.293074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47241f23-1955-4976-8ce1-0eed8321958f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:28.322323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 189/375] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:28.322960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb839-6e96-436e-9b1b-b90d4e0c9bf5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:28.328927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:28.329544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:28.329845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:28.330343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.331093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] RBAC: Adding query filter params (group.id=619443fcbfdc4931baf76315c1538c03, role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=8e424d66a95a494a86f95591ae27a0e3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:28.331401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.333131 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.339276 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 187/376] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:28 2022] GET /identity/v3/role_assignments?group.id=619443fcbfdc4931baf76315c1538c03&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:28.340116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:28.379451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:28.459691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561ade0-a694-4366-a633-276d54d9a03d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:28.474542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb839-6e96-436e-9b1b-b90d4e0c9bf5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:28.500121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3fb3d-e127-42a7-ae39-d53255613712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:28.500926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3fb3d-e127-42a7-ae39-d53255613712 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:28.501202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3fb3d-e127-42a7-ae39-d53255613712 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:28.501473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3fb3d-e127-42a7-ae39-d53255613712 None admin] PATH_INFO: `/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.502643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3fb3d-e127-42a7-ae39-d53255613712 None admin] RBAC: Authorizing `identity:get_project(project_id=0a3cc66b5da04b4f9bc679dee7bed60e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.504194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3fb3d-e127-42a7-ae39-d53255613712 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.506158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 188/377] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:28 2022] GET /identity/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:28.507568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:28.529382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3fb3d-e127-42a7-ae39-d53255613712 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:28.535925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:28.536623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:28.536905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:28.539237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.540042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] RBAC: Adding query filter params (role.id=d820a202bc2440d7b1f2a7190d4cae7c, user.id=20850edc5d744c4080ddeba81da66ab1, scope.system=all) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:28.540386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.542096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.569907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 190/378] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 10 11:04:28 2022] GET /identity/v3/role_assignments?user.id=20850edc5d744c4080ddeba81da66ab1&scope.system=all&role.id=d820a202bc2440d7b1f2a7190d4cae7c => generated 510 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:28.688620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3fb3d-e127-42a7-ae39-d53255613712 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:28.691962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:28.726402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437f13b-cac4-48a1-a2f8-d9c1a2313367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:28.727042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f13b-cac4-48a1-a2f8-d9c1a2313367 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:28.727320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f13b-cac4-48a1-a2f8-d9c1a2313367 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:28.727596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f13b-cac4-48a1-a2f8-d9c1a2313367 None admin] PATH_INFO: `/v3/groups/c5562fde5d2d4f408ed48290027c3ca0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.737069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437f13b-cac4-48a1-a2f8-d9c1a2313367 None admin] RBAC: Authorizing `identity:get_group(group_id=c5562fde5d2d4f408ed48290027c3ca0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.738565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437f13b-cac4-48a1-a2f8-d9c1a2313367 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.740682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 189/379] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:28 2022] GET /identity/v3/groups/c5562fde5d2d4f408ed48290027c3ca0 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:28.747457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:28.866987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d493d0-dc78-42c2-8f2b-2d740fc03ba9 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:28.903741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267303ba-0756-4d81-b9bb-99610c5a12eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:28.904390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267303ba-0756-4d81-b9bb-99610c5a12eb None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:28.904674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267303ba-0756-4d81-b9bb-99610c5a12eb None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:28.904946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267303ba-0756-4d81-b9bb-99610c5a12eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:28.905763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267303ba-0756-4d81-b9bb-99610c5a12eb None admin] RBAC: Adding query filter params (group.id=c5562fde5d2d4f408ed48290027c3ca0, role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=0a3cc66b5da04b4f9bc679dee7bed60e) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:28.906071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267303ba-0756-4d81-b9bb-99610c5a12eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:28.907914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267303ba-0756-4d81-b9bb-99610c5a12eb None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:28.914484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 191/380] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:28 2022] GET /identity/v3/role_assignments?group.id=c5562fde5d2d4f408ed48290027c3ca0&scope.project.id=0a3cc66b5da04b4f9bc679dee7bed60e&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:29.598122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a6a4-0f3d-4dbf-a445-6fa92d3a8f1f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:29.598808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a6a4-0f3d-4dbf-a445-6fa92d3a8f1f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:29.598808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a6a4-0f3d-4dbf-a445-6fa92d3a8f1f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:29.599990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 190/381] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:29.605603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3810a-883e-4f1b-ba7c-6b23167e0f9a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:29.606119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3810a-883e-4f1b-ba7c-6b23167e0f9a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:29.606273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3810a-883e-4f1b-ba7c-6b23167e0f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:29.633360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-45a3810a-883e-4f1b-ba7c-6b23167e0f9a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:29.634578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-45a3810a-883e-4f1b-ba7c-6b23167e0f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:29.677525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:29.721698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 192/382] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:29.757293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7a6a4-0f3d-4dbf-a445-6fa92d3a8f1f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:29.798221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef16fe-59d1-4484-b3f7-d2918054c847 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:29.798549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef16fe-59d1-4484-b3f7-d2918054c847 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:29.798779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef16fe-59d1-4484-b3f7-d2918054c847 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:29.800348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 193/383] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:29.808129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5b76-d903-47b7-b934-6fe07fa00f7d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:29.808433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5b76-d903-47b7-b934-6fe07fa00f7d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:29.808716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c5b76-d903-47b7-b934-6fe07fa00f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:29.837596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-7a3c5b76-d903-47b7-b934-6fe07fa00f7d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:29.838816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7a3c5b76-d903-47b7-b934-6fe07fa00f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:29.902475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7a6a4-0f3d-4dbf-a445-6fa92d3a8f1f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:29.950158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e665a1d-8b0b-4991-82c9-52e7d7c76036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:29.950810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e665a1d-8b0b-4991-82c9-52e7d7c76036 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:29.951090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e665a1d-8b0b-4991-82c9-52e7d7c76036 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:29.951360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e665a1d-8b0b-4991-82c9-52e7d7c76036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:29.970411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e665a1d-8b0b-4991-82c9-52e7d7c76036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9e665a1d-8b0b-4991-82c9-52e7d7c76036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:29.975572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:29.980657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:29.981670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:29.984679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 191/384] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:29.990422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e665a1d-8b0b-4991-82c9-52e7d7c76036 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:30.016964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 194/385] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:30.046174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c5b76-d903-47b7-b934-6fe07fa00f7d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:30.055659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:30.165327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c5b76-d903-47b7-b934-6fe07fa00f7d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:30.167276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:30.212041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e665a1d-8b0b-4991-82c9-52e7d7c76036 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:30.212976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d2680-57e7-44db-846b-f824062c33be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:30.214399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d2680-57e7-44db-846b-f824062c33be None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.214827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d2680-57e7-44db-846b-f824062c33be None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.215237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d2680-57e7-44db-846b-f824062c33be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.230422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d2680-57e7-44db-846b-f824062c33be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-c52d2680-57e7-44db-846b-f824062c33be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:30.235373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:30.238465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:30.239490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:30.241481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 195/386] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:30.249996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d2680-57e7-44db-846b-f824062c33be None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:30.280878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:30.281491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.281766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.282032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.282949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:30.283246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:30.284642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:30.300652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 192/387] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:30.306372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:30.428543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d2680-57e7-44db-846b-f824062c33be None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:30.476048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:30.491242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae41c27-c98a-4b3d-9aef-05ffec7bd740 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:30.493832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661552-2830-4565-be02-a344e886313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:30.494454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661552-2830-4565-be02-a344e886313a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.494725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661552-2830-4565-be02-a344e886313a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.495042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661552-2830-4565-be02-a344e886313a None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.495722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36661552-2830-4565-be02-a344e886313a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:30.501617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36661552-2830-4565-be02-a344e886313a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:30.501617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36661552-2830-4565-be02-a344e886313a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:30.515261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 196/388] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:30.520170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661552-2830-4565-be02-a344e886313a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:30.559181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:30.562134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d433e4-ede0-42ce-abb2-a297cb651fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:30.563120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d433e4-ede0-42ce-abb2-a297cb651fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.563423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d433e4-ede0-42ce-abb2-a297cb651fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.563705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d433e4-ede0-42ce-abb2-a297cb651fb7 None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.564879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d433e4-ede0-42ce-abb2-a297cb651fb7 None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:30.566374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d433e4-ede0-42ce-abb2-a297cb651fb7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:30.568350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 193/389] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:30 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:30.569889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531042e9-6516-4f48-8254-295b385a901b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.570239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531042e9-6516-4f48-8254-295b385a901b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.570600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531042e9-6516-4f48-8254-295b385a901b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.572845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 194/390] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:30.580356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a299-c28c-49f2-b3e5-bf76655ae383 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.580356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a299-c28c-49f2-b3e5-bf76655ae383 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.580356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a299-c28c-49f2-b3e5-bf76655ae383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.603080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-98e1a299-c28c-49f2-b3e5-bf76655ae383 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:30.606081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-98e1a299-c28c-49f2-b3e5-bf76655ae383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:30.668681 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661552-2830-4565-be02-a344e886313a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:30.698984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 195/391] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:30.700127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1a299-c28c-49f2-b3e5-bf76655ae383 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:30.709357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29beed3e-94e3-4799-9ba3-1ee6871d1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:30.710028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beed3e-94e3-4799-9ba3-1ee6871d1a3f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.710308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beed3e-94e3-4799-9ba3-1ee6871d1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.710585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beed3e-94e3-4799-9ba3-1ee6871d1a3f None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.711807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29beed3e-94e3-4799-9ba3-1ee6871d1a3f None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:30.719853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29beed3e-94e3-4799-9ba3-1ee6871d1a3f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:30.719853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 197/392] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:30 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:30.723026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29beed3e-94e3-4799-9ba3-1ee6871d1a3f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:30.843302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:30.857844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1a299-c28c-49f2-b3e5-bf76655ae383 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:30.886302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29beed3e-94e3-4799-9ba3-1ee6871d1a3f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:30.896684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:30.896954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cd968-e2d7-4b77-93d7-311e442b2e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:30.897589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cd968-e2d7-4b77-93d7-311e442b2e57 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.897870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cd968-e2d7-4b77-93d7-311e442b2e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.898142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cd968-e2d7-4b77-93d7-311e442b2e57 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.899347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cd968-e2d7-4b77-93d7-311e442b2e57 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:30.900824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cd968-e2d7-4b77-93d7-311e442b2e57 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:30.903340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 196/393] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:30 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:30.903951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cd968-e2d7-4b77-93d7-311e442b2e57 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:30.924841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b33a3-b846-42ba-b741-12c8dd984e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:30.925534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b33a3-b846-42ba-b741-12c8dd984e95 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:30.925813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b33a3-b846-42ba-b741-12c8dd984e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:30.926081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b33a3-b846-42ba-b741-12c8dd984e95 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:30.927263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b33a3-b846-42ba-b741-12c8dd984e95 None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:30.928837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b33a3-b846-42ba-b741-12c8dd984e95 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:30.930965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 198/394] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:30 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:30.931783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b33a3-b846-42ba-b741-12c8dd984e95 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.021569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cd968-e2d7-4b77-93d7-311e442b2e57 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:31.067470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae947e6-0f08-4daa-9d2d-617ab19aa6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:31.068114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae947e6-0f08-4daa-9d2d-617ab19aa6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.068449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae947e6-0f08-4daa-9d2d-617ab19aa6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.068720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae947e6-0f08-4daa-9d2d-617ab19aa6f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.068912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b33a3-b846-42ba-b741-12c8dd984e95 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:31.081081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae947e6-0f08-4daa-9d2d-617ab19aa6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1ae947e6-0f08-4daa-9d2d-617ab19aa6f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:31.086499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:31.087405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 197/395] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:31.089561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae947e6-0f08-4daa-9d2d-617ab19aa6f7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.113313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:31.124084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd48f4-a5a7-4b6b-b086-e32c2b055846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:31.126175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd48f4-a5a7-4b6b-b086-e32c2b055846 None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.126175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd48f4-a5a7-4b6b-b086-e32c2b055846 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.126175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd48f4-a5a7-4b6b-b086-e32c2b055846 None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/groups/619443fcbfdc4931baf76315c1538c03/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.130775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd48f4-a5a7-4b6b-b086-e32c2b055846 None admin] RBAC: Authorizing `identity:create_grant(project_id=299bafe38f4d4f39a7408242bcc8e7a4, group_id=619443fcbfdc4931baf76315c1538c03, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:31.131134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd48f4-a5a7-4b6b-b086-e32c2b055846 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:31.209696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 199/396] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 11:04:30 2022] PUT /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/groups/619443fcbfdc4931baf76315c1538c03/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:31.211200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08177ca-9110-467f-8542-809f4769b341 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.211492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08177ca-9110-467f-8542-809f4769b341 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.211779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08177ca-9110-467f-8542-809f4769b341 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.212793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae947e6-0f08-4daa-9d2d-617ab19aa6f7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:31.213153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 200/397] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:31.214456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08177ca-9110-467f-8542-809f4769b341 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.261671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:31.263711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edd42f-1255-4f5d-9a53-722a03c9d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:31.264425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd42f-1255-4f5d-9a53-722a03c9d81e None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.264762 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd42f-1255-4f5d-9a53-722a03c9d81e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.265034 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edd42f-1255-4f5d-9a53-722a03c9d81e None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/groups/619443fcbfdc4931baf76315c1538c03/roles/1b09a9c0489848ada69cb56ccf36aebd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.267324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edd42f-1255-4f5d-9a53-722a03c9d81e None admin] RBAC: Authorizing `identity:create_grant(project_id=299bafe38f4d4f39a7408242bcc8e7a4, group_id=619443fcbfdc4931baf76315c1538c03, role_id=1b09a9c0489848ada69cb56ccf36aebd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:31.268989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edd42f-1255-4f5d-9a53-722a03c9d81e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:31.334061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 198/398] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 11:04:31 2022] PUT /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4/groups/619443fcbfdc4931baf76315c1538c03/roles/1b09a9c0489848ada69cb56ccf36aebd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:31.335664 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66777d-18ba-48e1-b3ce-766e8bb11d78 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.335948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66777d-18ba-48e1-b3ce-766e8bb11d78 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.336476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66777d-18ba-48e1-b3ce-766e8bb11d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.359696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08177ca-9110-467f-8542-809f4769b341 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:31.361372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1f66777d-18ba-48e1-b3ce-766e8bb11d78 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:31.363977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f66777d-18ba-48e1-b3ce-766e8bb11d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:31.410399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:31.411081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.411355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.411623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.412302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:31.412798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:31.414291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:31.426734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 201/399] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:31.433640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.461736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 199/400] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:31.487925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66777d-18ba-48e1-b3ce-766e8bb11d78 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.505915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:31.561454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:31.586245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51ae4b-a192-446a-893b-5992d1bf4b03 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:31.637193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee9b8f-78e4-4975-a954-03786ba3c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:31.637900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9b8f-78e4-4975-a954-03786ba3c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.638175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9b8f-78e4-4975-a954-03786ba3c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.638445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9b8f-78e4-4975-a954-03786ba3c9b7 None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.641814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee9b8f-78e4-4975-a954-03786ba3c9b7 None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:31.643384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee9b8f-78e4-4975-a954-03786ba3c9b7 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:31.650109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 202/401] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:31 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:31.651866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9e314-24c7-4b27-93d4-8cfc7fd32b34 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.652155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9e314-24c7-4b27-93d4-8cfc7fd32b34 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.652489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9e314-24c7-4b27-93d4-8cfc7fd32b34 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.653924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 203/402] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:31.654461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9e314-24c7-4b27-93d4-8cfc7fd32b34 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.661558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66777d-18ba-48e1-b3ce-766e8bb11d78 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:31.711897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad54eb-5d69-4fe6-891c-2aa5b09bbbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:31.714140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad54eb-5d69-4fe6-891c-2aa5b09bbbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.714747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad54eb-5d69-4fe6-891c-2aa5b09bbbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.715687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad54eb-5d69-4fe6-891c-2aa5b09bbbe6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.730281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad54eb-5d69-4fe6-891c-2aa5b09bbbe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9cad54eb-5d69-4fe6-891c-2aa5b09bbbe6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:31.737198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:31.738163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:31.738985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:31.742317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 200/403] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:31.743793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb674c-8e58-405c-9a0e-056446f96f48 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.744225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb674c-8e58-405c-9a0e-056446f96f48 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.744687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb674c-8e58-405c-9a0e-056446f96f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.769683 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-85eb674c-8e58-405c-9a0e-056446f96f48 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:31.771422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-85eb674c-8e58-405c-9a0e-056446f96f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:31.777530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9e314-24c7-4b27-93d4-8cfc7fd32b34 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:31.822087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc00ea-5aab-4cf7-a48c-bbf352ea8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:31.822087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc00ea-5aab-4cf7-a48c-bbf352ea8033 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:31.822087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc00ea-5aab-4cf7-a48c-bbf352ea8033 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:31.822087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc00ea-5aab-4cf7-a48c-bbf352ea8033 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:31.825917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc00ea-5aab-4cf7-a48c-bbf352ea8033 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:31.827609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc00ea-5aab-4cf7-a48c-bbf352ea8033 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:31.834415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 204/404] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:31 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:31.835607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc00ea-5aab-4cf7-a48c-bbf352ea8033 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.857471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:31.859251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:31.869445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 201/405] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:31.870527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb674c-8e58-405c-9a0e-056446f96f48 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:31.971199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc00ea-5aab-4cf7-a48c-bbf352ea8033 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.001767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb674c-8e58-405c-9a0e-056446f96f48 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.013642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.014467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.014745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.014974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.015691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:32.015992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.017687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.027395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 205/406] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:32.028253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:32.052256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f9ddf-5c31-407d-b7d0-f92c30303a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.053288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f9ddf-5c31-407d-b7d0-f92c30303a9d None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.054346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f9ddf-5c31-407d-b7d0-f92c30303a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.054843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f9ddf-5c31-407d-b7d0-f92c30303a9d None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3/groups/619443fcbfdc4931baf76315c1538c03/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.057970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f9ddf-5c31-407d-b7d0-f92c30303a9d None admin] RBAC: Authorizing `identity:create_grant(project_id=8e424d66a95a494a86f95591ae27a0e3, group_id=619443fcbfdc4931baf76315c1538c03, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.060078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f9ddf-5c31-407d-b7d0-f92c30303a9d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.119204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:32.138323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42759e4e-d2a6-479d-810a-27c2bf0e5dc3 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.168707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 202/407] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 11:04:31 2022] PUT /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3/groups/619443fcbfdc4931baf76315c1538c03/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:32.170843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f9ddf-5c31-407d-b7d0-f92c30303a9d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:32.185743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ee9a-23ba-45b3-8950-ee5d321b445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.189728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ee9a-23ba-45b3-8950-ee5d321b445c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.189728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ee9a-23ba-45b3-8950-ee5d321b445c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.189728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ee9a-23ba-45b3-8950-ee5d321b445c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.205879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4ee9a-23ba-45b3-8950-ee5d321b445c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-63b4ee9a-23ba-45b3-8950-ee5d321b445c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:32.211508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:32.212517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:32.213312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 206/408] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:32.220096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ee9a-23ba-45b3-8950-ee5d321b445c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:32.311278 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:32.399195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ee9a-23ba-45b3-8950-ee5d321b445c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.399881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f9ddf-5c31-407d-b7d0-f92c30303a9d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.441266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10340990-f352-437d-bc28-e4f96ee355b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.441895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.442016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10340990-f352-437d-bc28-e4f96ee355b0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.442176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10340990-f352-437d-bc28-e4f96ee355b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.442451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10340990-f352-437d-bc28-e4f96ee355b0 None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.443240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.443589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10340990-f352-437d-bc28-e4f96ee355b0 None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.443955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.444537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.445063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10340990-f352-437d-bc28-e4f96ee355b0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.445635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:32.446159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.447003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 203/409] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:32 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:32.447965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.452848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10340990-f352-437d-bc28-e4f96ee355b0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:32.461081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 207/410] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:32.465270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:32.469428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:32.568535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10340990-f352-437d-bc28-e4f96ee355b0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.578134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63df69-6b70-41b8-be46-fe98d495e1b2 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.596385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:32.608735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461bc92-c1ef-49c5-8d67-398ddccd7b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.609720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461bc92-c1ef-49c5-8d67-398ddccd7b22 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.610170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461bc92-c1ef-49c5-8d67-398ddccd7b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.610604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461bc92-c1ef-49c5-8d67-398ddccd7b22 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.611896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461bc92-c1ef-49c5-8d67-398ddccd7b22 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.613995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461bc92-c1ef-49c5-8d67-398ddccd7b22 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.615676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1586-17f0-4323-8e15-456e281a20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.616347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1586-17f0-4323-8e15-456e281a20b1 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.616752 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1586-17f0-4323-8e15-456e281a20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.616915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1586-17f0-4323-8e15-456e281a20b1 None admin] PATH_INFO: `/v3/groups/c5562fde5d2d4f408ed48290027c3ca0` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.617075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 204/411] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:32 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:32.618223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e1586-17f0-4323-8e15-456e281a20b1 None admin] RBAC: Authorizing `identity:get_group(group_id=c5562fde5d2d4f408ed48290027c3ca0)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.619699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e1586-17f0-4323-8e15-456e281a20b1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.624612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 208/412] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:32 2022] GET /identity/v3/groups/c5562fde5d2d4f408ed48290027c3ca0 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:32.624734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461bc92-c1ef-49c5-8d67-398ddccd7b22 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:32.627141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1586-17f0-4323-8e15-456e281a20b1 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:32.706089 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:32.738657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1586-17f0-4323-8e15-456e281a20b1 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.780488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cb514-2c32-42da-9f31-aae4fff85796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.780488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cb514-2c32-42da-9f31-aae4fff85796 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.780488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cb514-2c32-42da-9f31-aae4fff85796 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.780488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cb514-2c32-42da-9f31-aae4fff85796 None admin] PATH_INFO: `/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.782585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cb514-2c32-42da-9f31-aae4fff85796 None admin] RBAC: Authorizing `identity:get_project(project_id=0a3cc66b5da04b4f9bc679dee7bed60e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.784153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cb514-2c32-42da-9f31-aae4fff85796 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.786461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 209/413] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:32 2022] GET /identity/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:32.792638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cb514-2c32-42da-9f31-aae4fff85796 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:32.914044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cb514-2c32-42da-9f31-aae4fff85796 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.922229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461bc92-c1ef-49c5-8d67-398ddccd7b22 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:32.953568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708008c-330c-4510-98c5-cc9d963c6a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.954334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708008c-330c-4510-98c5-cc9d963c6a9b None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.954686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708008c-330c-4510-98c5-cc9d963c6a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.955035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708008c-330c-4510-98c5-cc9d963c6a9b None admin] PATH_INFO: `/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e/groups/c5562fde5d2d4f408ed48290027c3ca0/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.957186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708008c-330c-4510-98c5-cc9d963c6a9b None admin] RBAC: Authorizing `identity:create_grant(project_id=0a3cc66b5da04b4f9bc679dee7bed60e, group_id=c5562fde5d2d4f408ed48290027c3ca0, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.959016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708008c-330c-4510-98c5-cc9d963c6a9b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:32.988370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adda9ff-92dc-42d0-af48-6a4cd3cd8a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:32.989047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adda9ff-92dc-42d0-af48-6a4cd3cd8a1b None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:32.989410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adda9ff-92dc-42d0-af48-6a4cd3cd8a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:32.989696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adda9ff-92dc-42d0-af48-6a4cd3cd8a1b None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3/groups/619443fcbfdc4931baf76315c1538c03/roles/1b09a9c0489848ada69cb56ccf36aebd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:32.992143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adda9ff-92dc-42d0-af48-6a4cd3cd8a1b None admin] RBAC: Authorizing `identity:create_grant(project_id=8e424d66a95a494a86f95591ae27a0e3, group_id=619443fcbfdc4931baf76315c1538c03, role_id=1b09a9c0489848ada69cb56ccf36aebd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:32.993654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adda9ff-92dc-42d0-af48-6a4cd3cd8a1b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:33.017770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:33.026653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 210/414] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 11:04:32 2022] PUT /identity/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e/groups/c5562fde5d2d4f408ed48290027c3ca0/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:33.086895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 205/415] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 10 11:04:32 2022] PUT /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3/groups/619443fcbfdc4931baf76315c1538c03/roles/1b09a9c0489848ada69cb56ccf36aebd => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:33.467000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8ae91-ed42-4765-b84d-08c3933751bc None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:33.467687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8ae91-ed42-4765-b84d-08c3933751bc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:33.468211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8ae91-ed42-4765-b84d-08c3933751bc None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:33.470050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 211/416] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:33.475821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512e7c4-e6f3-45dc-ab57-69c13f4a90af None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:33.476359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512e7c4-e6f3-45dc-ab57-69c13f4a90af None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:33.476826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512e7c4-e6f3-45dc-ab57-69c13f4a90af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:33.496569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c512e7c4-e6f3-45dc-ab57-69c13f4a90af None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:33.498130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c512e7c4-e6f3-45dc-ab57-69c13f4a90af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:33.572567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:33.597251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 206/417] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:33.618621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8ae91-ed42-4765-b84d-08c3933751bc None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:33.758011 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8ae91-ed42-4765-b84d-08c3933751bc None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:33.801584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb72a-fcde-40dd-93e6-10947f43a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:33.802213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb72a-fcde-40dd-93e6-10947f43a9ea None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:33.802489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb72a-fcde-40dd-93e6-10947f43a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:33.802760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeb72a-fcde-40dd-93e6-10947f43a9ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:33.812487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d8a41-2b51-4dd7-a091-ac43e71147d4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:33.812487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d8a41-2b51-4dd7-a091-ac43e71147d4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:33.812487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d8a41-2b51-4dd7-a091-ac43e71147d4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:33.817782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 207/418] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:33.825978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497334-6ad7-461b-b1e6-1a228d522cab None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:33.826652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497334-6ad7-461b-b1e6-1a228d522cab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:33.827473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e497334-6ad7-461b-b1e6-1a228d522cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:33.834372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeb72a-fcde-40dd-93e6-10947f43a9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-abeeb72a-fcde-40dd-93e6-10947f43a9ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:33.839148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:33.840069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:33.841216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 212/419] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:33.846136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb72a-fcde-40dd-93e6-10947f43a9ea None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:33.850309 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0e497334-6ad7-461b-b1e6-1a228d522cab None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:33.851708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0e497334-6ad7-461b-b1e6-1a228d522cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:33.934146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 208/420] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:33.960676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e497334-6ad7-461b-b1e6-1a228d522cab None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:33.978050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.053894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeb72a-fcde-40dd-93e6-10947f43a9ea None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:34.084433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e497334-6ad7-461b-b1e6-1a228d522cab None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:34.104956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.126042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:34.127038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.127521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.127993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.130006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:34.130515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:34.132808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:34.144498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cccde1-a649-446f-b7e1-9cd59298e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:34.145453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cccde1-a649-446f-b7e1-9cd59298e551 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.145931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cccde1-a649-446f-b7e1-9cd59298e551 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.146400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cccde1-a649-446f-b7e1-9cd59298e551 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.149242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 213/421] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:34.156006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:34.177071 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cccde1-a649-446f-b7e1-9cd59298e551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-69cccde1-a649-446f-b7e1-9cd59298e551 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:34.184916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:34.185830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:34.186630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:34.198436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 209/422] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:34.204272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cccde1-a649-446f-b7e1-9cd59298e551 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:34.275205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92993bb3-8f1d-42c5-bef6-76fbb94e52e9 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:34.298241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.319972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b4ab-4a64-422a-a871-1941424c2b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:34.319972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b4ab-4a64-422a-a871-1941424c2b5d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.319972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b4ab-4a64-422a-a871-1941424c2b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.319972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1b4ab-4a64-422a-a871-1941424c2b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.381635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1b4ab-4a64-422a-a871-1941424c2b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:34.383169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1b4ab-4a64-422a-a871-1941424c2b5d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:34.492727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 214/423] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 11:04:34.498946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b4ab-4a64-422a-a871-1941424c2b5d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:34.522416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.534393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cccde1-a649-446f-b7e1-9cd59298e551 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:34.608669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecede74e-6025-477c-a2ac-bb210a680b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:34.609219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecede74e-6025-477c-a2ac-bb210a680b09 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.609499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecede74e-6025-477c-a2ac-bb210a680b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.609771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecede74e-6025-477c-a2ac-bb210a680b09 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.610461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecede74e-6025-477c-a2ac-bb210a680b09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:34.611304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecede74e-6025-477c-a2ac-bb210a680b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:34.613026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecede74e-6025-477c-a2ac-bb210a680b09 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:34.623748 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1b4ab-4a64-422a-a871-1941424c2b5d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:34.624154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 210/424] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:34.625537 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68d34-1bf1-4820-a1c4-131c21c15b40 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.625822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68d34-1bf1-4820-a1c4-131c21c15b40 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.626092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68d34-1bf1-4820-a1c4-131c21c15b40 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.632126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 211/425] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:34.632126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68d34-1bf1-4820-a1c4-131c21c15b40 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:34.667791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce291b6a-ab28-46d9-b564-7cc7b3f7f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:34.668810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce291b6a-ab28-46d9-b564-7cc7b3f7f4eb None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.669298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce291b6a-ab28-46d9-b564-7cc7b3f7f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.669934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce291b6a-ab28-46d9-b564-7cc7b3f7f4eb None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.671430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce291b6a-ab28-46d9-b564-7cc7b3f7f4eb None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:34.673181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce291b6a-ab28-46d9-b564-7cc7b3f7f4eb None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:34.679747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 215/426] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:34 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:34.680373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.681788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5eb9d-75dc-4794-b2c9-22197f5baa9a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.683103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5eb9d-75dc-4794-b2c9-22197f5baa9a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.683575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5eb9d-75dc-4794-b2c9-22197f5baa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.707524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5fd5eb9d-75dc-4794-b2c9-22197f5baa9a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:34.709308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5fd5eb9d-75dc-4794-b2c9-22197f5baa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:34.762351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68d34-1bf1-4820-a1c4-131c21c15b40 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:34.788433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 216/427] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:34.789856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5eb9d-75dc-4794-b2c9-22197f5baa9a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:34.809304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20574a6-11a7-4293-8822-786bfefae367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:34.809921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20574a6-11a7-4293-8822-786bfefae367 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.810199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20574a6-11a7-4293-8822-786bfefae367 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.810469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20574a6-11a7-4293-8822-786bfefae367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.825930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.889827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20574a6-11a7-4293-8822-786bfefae367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:34.891678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20574a6-11a7-4293-8822-786bfefae367 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:34.926949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5eb9d-75dc-4794-b2c9-22197f5baa9a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:34.927831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:34.970503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc23cd-5940-486f-9339-833352709656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:34.971323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc23cd-5940-486f-9339-833352709656 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:34.971608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc23cd-5940-486f-9339-833352709656 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:34.971877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc23cd-5940-486f-9339-833352709656 None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:34.973032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc23cd-5940-486f-9339-833352709656 None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:34.974917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc23cd-5940-486f-9339-833352709656 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:34.976713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 217/428] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:34 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:34.978610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc23cd-5940-486f-9339-833352709656 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.008883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 212/429] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 11:04:35.010556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20574a6-11a7-4293-8822-786bfefae367 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.093381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:35.109982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc23cd-5940-486f-9339-833352709656 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:35.134520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20574a6-11a7-4293-8822-786bfefae367 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:35.151295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5146455-11e1-4377-9528-3364c2122b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.151822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5146455-11e1-4377-9528-3364c2122b66 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.152152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5146455-11e1-4377-9528-3364c2122b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.152398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5146455-11e1-4377-9528-3364c2122b66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.166251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5146455-11e1-4377-9528-3364c2122b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-a5146455-11e1-4377-9528-3364c2122b66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:35.172666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:35.173598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 11:04:35.174398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:35.175054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.175054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.175054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.175054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.175305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] RBAC: Adding query filter params (group.id=619443fcbfdc4931baf76315c1538c03, role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:35.175305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:35.176739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:35.177444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 218/430] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:35.178492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5146455-11e1-4377-9528-3364c2122b66 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.183823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:35.189700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 213/431] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:35 2022] GET /identity/v3/role_assignments?group.id=619443fcbfdc4931baf76315c1538c03&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:35.190965 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.312717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5146455-11e1-4377-9528-3364c2122b66 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:35.341261 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a82428-2a12-4c1f-9e22-2dbed8e76dfc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:35.358114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5502cb-b8f4-4657-a6e2-5c4ed50f104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.358114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5502cb-b8f4-4657-a6e2-5c4ed50f104a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.358385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5502cb-b8f4-4657-a6e2-5c4ed50f104a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.358453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5502cb-b8f4-4657-a6e2-5c4ed50f104a None admin] PATH_INFO: `/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.359681 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5502cb-b8f4-4657-a6e2-5c4ed50f104a None admin] RBAC: Authorizing `identity:get_project(project_id=299bafe38f4d4f39a7408242bcc8e7a4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:35.361190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5502cb-b8f4-4657-a6e2-5c4ed50f104a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:35.363818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 219/432] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:35 2022] GET /identity/v3/projects/299bafe38f4d4f39a7408242bcc8e7a4 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:35.369817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5502cb-b8f4-4657-a6e2-5c4ed50f104a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.389934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:35.405783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.406335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.406614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.406883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.407814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:35.408119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:35.409559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:35.419467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 214/433] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:04:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:35.425617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.513077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:35.514949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5502cb-b8f4-4657-a6e2-5c4ed50f104a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:35.567078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1fe4c-d665-4dc1-98c1-4a8f2523769c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:35.571326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e62eb-5cd7-4084-9f63-b27be75888dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.572362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e62eb-5cd7-4084-9f63-b27be75888dd None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.572891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e62eb-5cd7-4084-9f63-b27be75888dd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.573367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e62eb-5cd7-4084-9f63-b27be75888dd None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.574728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e62eb-5cd7-4084-9f63-b27be75888dd None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:35.576484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e62eb-5cd7-4084-9f63-b27be75888dd None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:35.579572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 220/434] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:35 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:35.586381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b51c0-2eaa-4e81-a92e-ffa4eeedc669 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.586670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b51c0-2eaa-4e81-a92e-ffa4eeedc669 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.586941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b51c0-2eaa-4e81-a92e-ffa4eeedc669 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.589504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 221/435] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:35.590196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b51c0-2eaa-4e81-a92e-ffa4eeedc669 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.616811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548a163-05e5-4fb4-8da3-1a6c2b1ef3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.617421 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a163-05e5-4fb4-8da3-1a6c2b1ef3bb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.617701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a163-05e5-4fb4-8da3-1a6c2b1ef3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.617974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a163-05e5-4fb4-8da3-1a6c2b1ef3bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.692633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548a163-05e5-4fb4-8da3-1a6c2b1ef3bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:35.694046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548a163-05e5-4fb4-8da3-1a6c2b1ef3bb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:35.695554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:35.716515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b51c0-2eaa-4e81-a92e-ffa4eeedc669 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:35.751209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f2655-1431-4cd2-85d9-73625b15d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.751834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2655-1431-4cd2-85d9-73625b15d366 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.752111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2655-1431-4cd2-85d9-73625b15d366 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.752412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2655-1431-4cd2-85d9-73625b15d366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.753127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f2655-1431-4cd2-85d9-73625b15d366 None admin] RBAC: Adding query filter params (group.id=619443fcbfdc4931baf76315c1538c03, role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:35.753433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f2655-1431-4cd2-85d9-73625b15d366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:35.754765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:35.754872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f2655-1431-4cd2-85d9-73625b15d366 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:35.761166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 222/436] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:35 2022] GET /identity/v3/role_assignments?group.id=619443fcbfdc4931baf76315c1538c03&scope.project.id=299bafe38f4d4f39a7408242bcc8e7a4&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:35.762235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97421-1dbc-4bd2-ba20-0bac6c4c7799 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.772227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97421-1dbc-4bd2-ba20-0bac6c4c7799 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.772227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97421-1dbc-4bd2-ba20-0bac6c4c7799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.781517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-b2f97421-1dbc-4bd2-ba20-0bac6c4c7799 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:35.783002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b2f97421-1dbc-4bd2-ba20-0bac6c4c7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:35.816951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 215/437] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:35.818588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb1f8d-52b0-43ad-a9fe-af6863fcd5f4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.818877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb1f8d-52b0-43ad-a9fe-af6863fcd5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.819152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb1f8d-52b0-43ad-a9fe-af6863fcd5f4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.820739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 216/438] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:35.826157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb1f8d-52b0-43ad-a9fe-af6863fcd5f4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.872717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 223/439] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:35.874653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c4a5a-26ad-448a-90b1-99385d3aa414 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.875068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c4a5a-26ad-448a-90b1-99385d3aa414 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.875468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c4a5a-26ad-448a-90b1-99385d3aa414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.896444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-724c4a5a-26ad-448a-90b1-99385d3aa414 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:35.897937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-724c4a5a-26ad-448a-90b1-99385d3aa414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:35.952732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb1f8d-52b0-43ad-a9fe-af6863fcd5f4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:35.979986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 224/440] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:35.981931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c4a5a-26ad-448a-90b1-99385d3aa414 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:35.992048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:35.993172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adf1a6-a33b-499a-bada-29c926cc8852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:35.993635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf1a6-a33b-499a-bada-29c926cc8852 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:35.993851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf1a6-a33b-499a-bada-29c926cc8852 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:35.994122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf1a6-a33b-499a-bada-29c926cc8852 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:35.995435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adf1a6-a33b-499a-bada-29c926cc8852 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:35.996906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adf1a6-a33b-499a-bada-29c926cc8852 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.000391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 217/441] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:35 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:36.003877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adf1a6-a33b-499a-bada-29c926cc8852 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.037031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.109005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c4a5a-26ad-448a-90b1-99385d3aa414 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.124617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adf1a6-a33b-499a-bada-29c926cc8852 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.149787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6615-18f1-4dbe-8e77-728ea103996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.150422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6615-18f1-4dbe-8e77-728ea103996c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.150781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6615-18f1-4dbe-8e77-728ea103996c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.151555 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6615-18f1-4dbe-8e77-728ea103996c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.161668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51775f14-a1cf-487b-8eaa-b44a82c25f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.161830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d6615-18f1-4dbe-8e77-728ea103996c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:36.162296 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51775f14-a1cf-487b-8eaa-b44a82c25f42 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.162577 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51775f14-a1cf-487b-8eaa-b44a82c25f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.162844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51775f14-a1cf-487b-8eaa-b44a82c25f42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-ee6d6615-18f1-4dbe-8e77-728ea103996c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:36.166327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:36.167872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 225/442] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:36.169142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6615-18f1-4dbe-8e77-728ea103996c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.177556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51775f14-a1cf-487b-8eaa-b44a82c25f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-51775f14-a1cf-487b-8eaa-b44a82c25f42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:36.182665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:36.183787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:36.184864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 218/443] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:36.185623 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51775f14-a1cf-487b-8eaa-b44a82c25f42 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.241665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.272333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.277334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6615-18f1-4dbe-8e77-728ea103996c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.284950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51775f14-a1cf-487b-8eaa-b44a82c25f42 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.311051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48838c6e-9126-4907-a74e-e6bd5f381fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.311675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838c6e-9126-4907-a74e-e6bd5f381fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.311956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838c6e-9126-4907-a74e-e6bd5f381fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.312233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48838c6e-9126-4907-a74e-e6bd5f381fd3 None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.313390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48838c6e-9126-4907-a74e-e6bd5f381fd3 None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.314839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48838c6e-9126-4907-a74e-e6bd5f381fd3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.316407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 226/444] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:36.317159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48838c6e-9126-4907-a74e-e6bd5f381fd3 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.318431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.319040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.319320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.319594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.320257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:36.320589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.321933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.330509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 219/445] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:36.331293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.420052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48838c6e-9126-4907-a74e-e6bd5f381fd3 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.428321 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac92ea-f1df-438a-a73e-295ae9a380f0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.452759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.453356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.453635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.453906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.454566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:36.454866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.456253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.457796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.461936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.462536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.462815 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.463113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.463903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] RBAC: Adding query filter params (group.id=619443fcbfdc4931baf76315c1538c03, role.id=7d605c5d717e4621bdfa8a6bc3da9a0a, scope.project.id=8e424d66a95a494a86f95591ae27a0e3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:36.464210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.465134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 227/446] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:36.470763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.470865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.476013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 220/447] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/role_assignments?group.id=619443fcbfdc4931baf76315c1538c03&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=7d605c5d717e4621bdfa8a6bc3da9a0a => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:36.476816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.495989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.580071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebb48-f780-4b87-8867-933ca140c318 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.594346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b2d0e-6649-4ec9-85c3-6633a347ed56 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.617053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb92791-77e4-4005-9c00-fd5b86a0e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.617679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb92791-77e4-4005-9c00-fd5b86a0e531 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.617987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb92791-77e4-4005-9c00-fd5b86a0e531 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.618768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb92791-77e4-4005-9c00-fd5b86a0e531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.634878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a17e-b057-4fc8-b342-6e2ed5bb0648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.636117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a17e-b057-4fc8-b342-6e2ed5bb0648 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.636437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a17e-b057-4fc8-b342-6e2ed5bb0648 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.637354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4a17e-b057-4fc8-b342-6e2ed5bb0648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.701491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.709086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb92791-77e4-4005-9c00-fd5b86a0e531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.710569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb92791-77e4-4005-9c00-fd5b86a0e531 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.713016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4a17e-b057-4fc8-b342-6e2ed5bb0648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.715532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4a17e-b057-4fc8-b342-6e2ed5bb0648 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.732508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.828345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 221/448] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:36.828504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 228/449] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:36.833259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a17e-b057-4fc8-b342-6e2ed5bb0648 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.834159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb92791-77e4-4005-9c00-fd5b86a0e531 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.928093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.934206 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4a17e-b057-4fc8-b342-6e2ed5bb0648 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.940186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb92791-77e4-4005-9c00-fd5b86a0e531 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:36.947140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:36.966452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da540d92-9fea-4b3f-98dd-76a176095bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.967351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da540d92-9fea-4b3f-98dd-76a176095bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.967446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da540d92-9fea-4b3f-98dd-76a176095bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.967643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f84c9-5b8a-4361-8fac-296b469d60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:36.967772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da540d92-9fea-4b3f-98dd-76a176095bd8 None admin] PATH_INFO: `/v3/projects/8e424d66a95a494a86f95591ae27a0e3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.968263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f84c9-5b8a-4361-8fac-296b469d60fe None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:36.968569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f84c9-5b8a-4361-8fac-296b469d60fe None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:36.968784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da540d92-9fea-4b3f-98dd-76a176095bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=8e424d66a95a494a86f95591ae27a0e3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.968884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f84c9-5b8a-4361-8fac-296b469d60fe None admin] PATH_INFO: `/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:36.969955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f84c9-5b8a-4361-8fac-296b469d60fe None admin] RBAC: Authorizing `identity:get_project(project_id=0a3cc66b5da04b4f9bc679dee7bed60e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:36.970249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da540d92-9fea-4b3f-98dd-76a176095bd8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.971373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f84c9-5b8a-4361-8fac-296b469d60fe None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:36.971935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 222/450] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/projects/8e424d66a95a494a86f95591ae27a0e3 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:36.977256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 229/451] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/projects/0a3cc66b5da04b4f9bc679dee7bed60e => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:36.977843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da540d92-9fea-4b3f-98dd-76a176095bd8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:36.978172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f84c9-5b8a-4361-8fac-296b469d60fe None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:37.078151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da540d92-9fea-4b3f-98dd-76a176095bd8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:37.085220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f84c9-5b8a-4361-8fac-296b469d60fe None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:37.112019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90a273-215b-44f8-a5b7-704b86696e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:37.112680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90a273-215b-44f8-a5b7-704b86696e93 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:37.112961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90a273-215b-44f8-a5b7-704b86696e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:37.113233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90a273-215b-44f8-a5b7-704b86696e93 None admin] PATH_INFO: `/v3/groups/619443fcbfdc4931baf76315c1538c03` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:37.114338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90a273-215b-44f8-a5b7-704b86696e93 None admin] RBAC: Authorizing `identity:get_group(group_id=619443fcbfdc4931baf76315c1538c03)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:37.115764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90a273-215b-44f8-a5b7-704b86696e93 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:37.117339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 223/452] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/groups/619443fcbfdc4931baf76315c1538c03 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:37.118918 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0806e0-5922-4831-bd88-15156f041785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:37.119662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0806e0-5922-4831-bd88-15156f041785 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:37.119951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0806e0-5922-4831-bd88-15156f041785 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:37.120218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0806e0-5922-4831-bd88-15156f041785 None admin] PATH_INFO: `/v3/groups/c5562fde5d2d4f408ed48290027c3ca0` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:37.121366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0806e0-5922-4831-bd88-15156f041785 None admin] RBAC: Authorizing `identity:get_group(group_id=c5562fde5d2d4f408ed48290027c3ca0)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:37.126243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0806e0-5922-4831-bd88-15156f041785 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:37.126418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90a273-215b-44f8-a5b7-704b86696e93 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:37.126521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 230/453] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 10 11:04:36 2022] GET /identity/v3/groups/c5562fde5d2d4f408ed48290027c3ca0 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:37.130161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0806e0-5922-4831-bd88-15156f041785 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:37.162573 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:37.181826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:37.232896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0806e0-5922-4831-bd88-15156f041785 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:37.243254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90a273-215b-44f8-a5b7-704b86696e93 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:37.266402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4c079-1d52-497b-88a6-103bae65fefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:37.267002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c079-1d52-497b-88a6-103bae65fefc None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:37.267281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c079-1d52-497b-88a6-103bae65fefc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:37.267551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4c079-1d52-497b-88a6-103bae65fefc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:37.268275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c079-1d52-497b-88a6-103bae65fefc None admin] RBAC: Adding query filter params (group.id=c5562fde5d2d4f408ed48290027c3ca0, role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=0a3cc66b5da04b4f9bc679dee7bed60e) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:37.268618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c079-1d52-497b-88a6-103bae65fefc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:37.270041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4c079-1d52-497b-88a6-103bae65fefc None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:37.276916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 231/454] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:37 2022] GET /identity/v3/role_assignments?group.id=c5562fde5d2d4f408ed48290027c3ca0&scope.project.id=0a3cc66b5da04b4f9bc679dee7bed60e&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:37.300110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a33842-f32f-428b-9377-0def58a64f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:37.300786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33842-f32f-428b-9377-0def58a64f9d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:37.301063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33842-f32f-428b-9377-0def58a64f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:37.301331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33842-f32f-428b-9377-0def58a64f9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:37.302085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a33842-f32f-428b-9377-0def58a64f9d None admin] RBAC: Adding query filter params (group.id=619443fcbfdc4931baf76315c1538c03, role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=8e424d66a95a494a86f95591ae27a0e3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:37.302392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a33842-f32f-428b-9377-0def58a64f9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:37.303928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a33842-f32f-428b-9377-0def58a64f9d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:37.311118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 224/455] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 10 11:04:37 2022] GET /identity/v3/role_assignments?group.id=619443fcbfdc4931baf76315c1538c03&scope.project.id=8e424d66a95a494a86f95591ae27a0e3&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:39.880218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e38881-730d-4618-b30a-def1c0f39453 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:39.880779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e38881-730d-4618-b30a-def1c0f39453 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:39.880779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e38881-730d-4618-b30a-def1c0f39453 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:39.882344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 232/456] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:39.887770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a48d4-e019-4e69-936b-1b25cbe9c467 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:39.888588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a48d4-e019-4e69-936b-1b25cbe9c467 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:39.889087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a48d4-e019-4e69-936b-1b25cbe9c467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:39.911854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e73a48d4-e019-4e69-936b-1b25cbe9c467 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:39.913424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e73a48d4-e019-4e69-936b-1b25cbe9c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:40.006820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 225/457] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:40.047351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e38881-730d-4618-b30a-def1c0f39453 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:40.173313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:40.182611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e38881-730d-4618-b30a-def1c0f39453 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:40.225062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:40.226274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.226813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.227638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.240279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875cb3-62c7-4032-bced-4ef7f2022b51 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.240594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875cb3-62c7-4032-bced-4ef7f2022b51 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.240868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875cb3-62c7-4032-bced-4ef7f2022b51 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.242213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:40.242440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 226/458] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:40.243666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:40.248275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddaf00-aa77-40b6-a72d-ecbe8da226c5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.248586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddaf00-aa77-40b6-a72d-ecbe8da226c5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.248861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddaf00-aa77-40b6-a72d-ecbe8da226c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:40.273356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:40.274340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:40.275717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:40.275717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:40.275717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:40.277798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 233/459] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:40.278714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c3ddaf00-aa77-40b6-a72d-ecbe8da226c5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:40.279892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c3ddaf00-aa77-40b6-a72d-ecbe8da226c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:40.282913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:40.328804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:40.364575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 227/460] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:40.366061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4e196-6160-4d06-85ef-b56224e0165c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.366349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4e196-6160-4d06-85ef-b56224e0165c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.366619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4e196-6160-4d06-85ef-b56224e0165c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.368195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 228/461] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:40.379482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858f03-0b0c-461f-9f65-cdd50229ee0a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.379838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858f03-0b0c-461f-9f65-cdd50229ee0a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.380116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05858f03-0b0c-461f-9f65-cdd50229ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.389605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9e56-bc2e-474d-b2cf-843c86a24568 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:40.414838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-05858f03-0b0c-461f-9f65-cdd50229ee0a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:40.416691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-05858f03-0b0c-461f-9f65-cdd50229ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:40.431036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:40.436112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.436455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.436728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.437390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:40.437687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:40.439080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:40.452430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 234/462] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:40.453283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:40.464581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:40.490854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 229/463] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:40.491513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05858f03-0b0c-461f-9f65-cdd50229ee0a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:40.554073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750e14-abe3-4738-b6c7-43773181a709 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:40.589582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:40.590364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.590744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.591146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.603390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:40.605987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:40.622090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05858f03-0b0c-461f-9f65-cdd50229ee0a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:40.623257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:40.624121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:40.625010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:40.625010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:40.625010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:40.625171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:40.626153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 235/464] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:40.627013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:40.664203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb91b63-be09-4138-9396-e0f5a32711a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:40.664868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91b63-be09-4138-9396-e0f5a32711a9 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.665175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91b63-be09-4138-9396-e0f5a32711a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.665449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91b63-be09-4138-9396-e0f5a32711a9 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.666605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb91b63-be09-4138-9396-e0f5a32711a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:40.668349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb91b63-be09-4138-9396-e0f5a32711a9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:40.696599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:40.734653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae1b0d-ee1e-4986-8660-dbb894a43132 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:40.766412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c33e21-1bf9-4ec3-bb61-8031876bcc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:40.767028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33e21-1bf9-4ec3-bb61-8031876bcc71 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.767301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33e21-1bf9-4ec3-bb61-8031876bcc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.767570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c33e21-1bf9-4ec3-bb61-8031876bcc71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.777632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c33e21-1bf9-4ec3-bb61-8031876bcc71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:40.779062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c33e21-1bf9-4ec3-bb61-8031876bcc71 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:40.788368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 230/465] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:40 2022] POST /identity/v3/users => generated 246 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:40.789472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb91b63-be09-4138-9396-e0f5a32711a9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-64c33e21-1bf9-4ec3-bb61-8031876bcc71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:40.793380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:40.794324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 236/466] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d136bd-c1af-4dee-a1e8-375c00695558 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d136bd-c1af-4dee-a1e8-375c00695558 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d136bd-c1af-4dee-a1e8-375c00695558 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 237/467] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:40.803638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d136bd-c1af-4dee-a1e8-375c00695558 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:40.933079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb91b63-be09-4138-9396-e0f5a32711a9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:40.965906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d136bd-c1af-4dee-a1e8-375c00695558 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:40.972203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c75f8-bf90-48e1-923c-fe5c9ba8b049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:40.972871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c75f8-bf90-48e1-923c-fe5c9ba8b049 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.973152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c75f8-bf90-48e1-923c-fe5c9ba8b049 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.973424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c75f8-bf90-48e1-923c-fe5c9ba8b049 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:40.974146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c75f8-bf90-48e1-923c-fe5c9ba8b049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:40.974455 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c75f8-bf90-48e1-923c-fe5c9ba8b049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:40.975827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c75f8-bf90-48e1-923c-fe5c9ba8b049 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:40.980510 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:40.990102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 231/468] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:40.991212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f551725-666b-4770-8f8b-52221fd793d8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:40.991498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f551725-666b-4770-8f8b-52221fd793d8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:40.991814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f551725-666b-4770-8f8b-52221fd793d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.004163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:41.005125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.006144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.006595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.007699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:41.008004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:41.009411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:41.012483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6f551725-666b-4770-8f8b-52221fd793d8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:41.013869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6f551725-666b-4770-8f8b-52221fd793d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:41.024115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 238/469] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:41.024818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:41.029767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:41.107732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 232/470] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:41.107732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f551725-666b-4770-8f8b-52221fd793d8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:41.164466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6404ec2-06e4-4a0e-9cb1-df3b6da6dc7b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:41.201933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed62f3-f5cf-49fa-bd8a-62fca8decbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:41.202674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed62f3-f5cf-49fa-bd8a-62fca8decbac None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.203273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed62f3-f5cf-49fa-bd8a-62fca8decbac None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.203645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed62f3-f5cf-49fa-bd8a-62fca8decbac None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.204467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed62f3-f5cf-49fa-bd8a-62fca8decbac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:41.206627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed62f3-f5cf-49fa-bd8a-62fca8decbac None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:41.225134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f551725-666b-4770-8f8b-52221fd793d8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:41.261760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef99e46-91ae-4a23-9eb0-16fbdca96266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:41.262674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef99e46-91ae-4a23-9eb0-16fbdca96266 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.262941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef99e46-91ae-4a23-9eb0-16fbdca96266 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.263210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef99e46-91ae-4a23-9eb0-16fbdca96266 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.263846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef99e46-91ae-4a23-9eb0-16fbdca96266 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:41.265361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef99e46-91ae-4a23-9eb0-16fbdca96266 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:41.282818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 239/471] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:41 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:41.284496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed62f3-f5cf-49fa-bd8a-62fca8decbac None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:41.319130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:41.390843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 233/472] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:41 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:41.419914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed62f3-f5cf-49fa-bd8a-62fca8decbac None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:41.481277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe386c-ea26-4c6d-b636-6b098f4c8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:41.482385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe386c-ea26-4c6d-b636-6b098f4c8f02 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.482880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe386c-ea26-4c6d-b636-6b098f4c8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.483375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe386c-ea26-4c6d-b636-6b098f4c8f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.495869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe386c-ea26-4c6d-b636-6b098f4c8f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:41.497817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe386c-ea26-4c6d-b636-6b098f4c8f02 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-bebe386c-ea26-4c6d-b636-6b098f4c8f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:41.515902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:41.516944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:41.517801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:41.517801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:41.517801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:41.520150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 240/473] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:41.529745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef99e46-91ae-4a23-9eb0-16fbdca96266 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:41.541575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:41.542148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd0805-9a5d-48ef-98d4-3f5d4cdae3f5 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.542434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd0805-9a5d-48ef-98d4-3f5d4cdae3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.542707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd0805-9a5d-48ef-98d4-3f5d4cdae3f5 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.544461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 241/474] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:41.550323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e2aa-dfdb-4b3f-8c5e-ffd7ea51c6ae None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.550507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e2aa-dfdb-4b3f-8c5e-ffd7ea51c6ae None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.550769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e2aa-dfdb-4b3f-8c5e-ffd7ea51c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.574222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-3df9e2aa-dfdb-4b3f-8c5e-ffd7ea51c6ae None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:41.575206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3df9e2aa-dfdb-4b3f-8c5e-ffd7ea51c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:41.652578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef99e46-91ae-4a23-9eb0-16fbdca96266 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:41.660007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 242/475] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:41.684805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9e2aa-dfdb-4b3f-8c5e-ffd7ea51c6ae None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:41.693402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:41.694033 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.694315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.694592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.695252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:41.695599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:41.697004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:41.709697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 234/476] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:41.710386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:41.716509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:41.799545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:41.807013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9e2aa-dfdb-4b3f-8c5e-ffd7ea51c6ae None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:41.839716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10088411-35e8-4256-9df8-3848105b8cae None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:41.857299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:41.858447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.858682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.858961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.859785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:41.861501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:41.885509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bbcba-01aa-4dcb-a5de-a422e622df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:41.886134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bbcba-01aa-4dcb-a5de-a422e622df87 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:41.886412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bbcba-01aa-4dcb-a5de-a422e622df87 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:41.886680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bbcba-01aa-4dcb-a5de-a422e622df87 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:41.887327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bbcba-01aa-4dcb-a5de-a422e622df87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:41.888853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bbcba-01aa-4dcb-a5de-a422e622df87 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:41.902187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.sql.core [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 11:04:41.902187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 11:04:41.902187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [parameters: {'id': '64dd87e0450148d3a205adc114ad5722', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 11:04:41.902187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application conn.query(q) Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result.read() Aug 10 11:04:41.926118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 11:04:41.927045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application next(self.gen) Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application yield resource Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application next(self.gen) Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise self.value Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application session.commit() Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 11:04:41.927969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.session.flush() Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application compat.raise_( Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 11:04:41.928873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 11:04:41.929756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application conn.query(q) Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result.read() Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 11:04:41.930589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [parameters: {'id': '64dd87e0450148d3a205adc114ad5722', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:41.931376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 11:04:41.932230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:41.936691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 243/477] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 11:04:41 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:41.936691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:42.007128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 235/478] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:41 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:42.040762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:42.063465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4bb59-dbd9-48b8-865f-49af148c72f1 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:42.125064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84021e-a95f-4ba2-b9cc-7672ef305cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:42.125734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84021e-a95f-4ba2-b9cc-7672ef305cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:42.126010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84021e-a95f-4ba2-b9cc-7672ef305cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:42.126282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84021e-a95f-4ba2-b9cc-7672ef305cd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:42.149447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84021e-a95f-4ba2-b9cc-7672ef305cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-7c84021e-a95f-4ba2-b9cc-7672ef305cd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:42.154955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:42.155891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:42.157414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 244/479] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:04:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:42.164162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bbcba-01aa-4dcb-a5de-a422e622df87 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:42.277901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bbcba-01aa-4dcb-a5de-a422e622df87 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:42.302467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:42.318450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cdc90-5483-4743-97ea-64a1975a2c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:42.319366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cdc90-5483-4743-97ea-64a1975a2c3d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:42.319849 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cdc90-5483-4743-97ea-64a1975a2c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:42.320356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cdc90-5483-4743-97ea-64a1975a2c3d None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:42.321245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cdc90-5483-4743-97ea-64a1975a2c3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:42.321749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cdc90-5483-4743-97ea-64a1975a2c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:42.323736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cdc90-5483-4743-97ea-64a1975a2c3d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:42.338205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 236/480] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:43.248618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768716-bf88-4b5c-bf76-3218a09c08df None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.249166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768716-bf88-4b5c-bf76-3218a09c08df None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.249166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04768716-bf88-4b5c-bf76-3218a09c08df None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.252846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 245/481] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:43.258410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023eb4f-3d3e-4fe9-9263-01c2e09cd09b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.258830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023eb4f-3d3e-4fe9-9263-01c2e09cd09b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.259002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023eb4f-3d3e-4fe9-9263-01c2e09cd09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.285319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1023eb4f-3d3e-4fe9-9263-01c2e09cd09b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:43.286521 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1023eb4f-3d3e-4fe9-9263-01c2e09cd09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:43.378484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 237/482] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:43.426291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04768716-bf88-4b5c-bf76-3218a09c08df None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:43.549188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04768716-bf88-4b5c-bf76-3218a09c08df None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:43.583221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575544-8ac9-42b7-b5b7-bc5dbc774dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:43.583855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575544-8ac9-42b7-b5b7-bc5dbc774dfa None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.584130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575544-8ac9-42b7-b5b7-bc5dbc774dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.584476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575544-8ac9-42b7-b5b7-bc5dbc774dfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.586371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:43.595827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db575544-8ac9-42b7-b5b7-bc5dbc774dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-db575544-8ac9-42b7-b5b7-bc5dbc774dfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:43.600471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:43.602570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:43.604194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 246/483] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:43.607978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023eb4f-3d3e-4fe9-9263-01c2e09cd09b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:43.725358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023eb4f-3d3e-4fe9-9263-01c2e09cd09b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:43.745444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:43.772415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434aa5-a017-44b4-99ee-23169e1ec56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:43.773036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434aa5-a017-44b4-99ee-23169e1ec56e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.773314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434aa5-a017-44b4-99ee-23169e1ec56e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.773581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434aa5-a017-44b4-99ee-23169e1ec56e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.774250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68434aa5-a017-44b4-99ee-23169e1ec56e None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:43.774548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68434aa5-a017-44b4-99ee-23169e1ec56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:43.775995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68434aa5-a017-44b4-99ee-23169e1ec56e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:43.785303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 238/484] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:43.793400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575544-8ac9-42b7-b5b7-bc5dbc774dfa None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:43.936041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575544-8ac9-42b7-b5b7-bc5dbc774dfa None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:43.943591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecade-c9de-4ff4-8c76-33d379dcac6b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.943900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecade-c9de-4ff4-8c76-33d379dcac6b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.944137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecade-c9de-4ff4-8c76-33d379dcac6b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.945538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 239/485] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:43.961792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f5c-5677-42b6-948f-4f89ab960150 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:43.962100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f5c-5677-42b6-948f-4f89ab960150 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:43.962338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d82f5c-5677-42b6-948f-4f89ab960150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:43.983323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e9d82f5c-5677-42b6-948f-4f89ab960150 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:43.984729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e9d82f5c-5677-42b6-948f-4f89ab960150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:44.004060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.004731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.005010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.005284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.023997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:44.026199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:44.041538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:44.042457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:44.043485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:44.043485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:44.043485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:44.043485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 247/486] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:44.047976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.095374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 240/487] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:44.096664 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259c04e-795f-4c6c-818b-23babc144483 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.096948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259c04e-795f-4c6c-818b-23babc144483 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.097222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259c04e-795f-4c6c-818b-23babc144483 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.100345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 241/488] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:44.104911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3e3a-5e0e-4cdd-8608-9422bca1cbba None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.105265 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3e3a-5e0e-4cdd-8608-9422bca1cbba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.105605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3e3a-5e0e-4cdd-8608-9422bca1cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.126178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:44.128983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1e8e3e3a-5e0e-4cdd-8608-9422bca1cbba None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:44.130167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1e8e3e3a-5e0e-4cdd-8608-9422bca1cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:44.191881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02061989-cc14-43cc-8a6a-9dcd17fa3547 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.216562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 242/489] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:44.217994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e3e3a-5e0e-4cdd-8608-9422bca1cbba None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.227420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.228889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.228889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.229219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.229758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:44.230063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:44.231437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:44.243930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 248/490] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:44.249407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.263955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:44.356672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e3e3a-5e0e-4cdd-8608-9422bca1cbba None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.363699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986dd4-e1e8-4b41-8d1a-45eb5c7bec33 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.375099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:44.394663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf44e3-a5e3-4f2b-8032-272bf9be2c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.395916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf44e3-a5e3-4f2b-8032-272bf9be2c72 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.396693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf44e3-a5e3-4f2b-8032-272bf9be2c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.397162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf44e3-a5e3-4f2b-8032-272bf9be2c72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.409053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.410832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.410832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.410832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.412784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf44e3-a5e3-4f2b-8032-272bf9be2c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:44.418075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cecf44e3-a5e3-4f2b-8032-272bf9be2c72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:44.419158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:44.420031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:44.420861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:44.421487 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:44.422336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 243/491] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:44.422946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf44e3-a5e3-4f2b-8032-272bf9be2c72 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:44.442068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:44.443057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:04:44.444046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:44.448337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 249/492] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:44.449345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.557764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439415-ef67-4c83-9625-643c37d8fe3d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.558986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:44.566216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf44e3-a5e3-4f2b-8032-272bf9be2c72 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.603119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.603811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8af7d-5983-4d89-857b-5bd09a60f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.604092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.604408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.604685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.605272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8af7d-5983-4d89-857b-5bd09a60f88a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.605376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:44.605651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:44.606053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8af7d-5983-4d89-857b-5bd09a60f88a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.606494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8af7d-5983-4d89-857b-5bd09a60f88a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.607094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:44.620105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8af7d-5983-4d89-857b-5bd09a60f88a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:44.620659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 250/493] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:44.621639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-54c8af7d-5983-4d89-857b-5bd09a60f88a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:44.626873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:44.627780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:44.628633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:44.631320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 244/494] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:44.632976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8af7d-5983-4d89-857b-5bd09a60f88a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.662295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:44.746609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8af7d-5983-4d89-857b-5bd09a60f88a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.758765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876b7d3-e190-4d88-ad63-b27699182761 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.782748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.783572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.783836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.784180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.795401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:44.797023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:44.804660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.805534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.807013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.807470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.808662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:44.809168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:44.810778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:44.813156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:44.814060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:44.814905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:44.814905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:44.814905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:44.814905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 245/495] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:44.815128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.836744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:44.857824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 251/496] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:44.858664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:44.933130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6505e3-9778-46b3-a10a-63ac34f48c86 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.945966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:44.960388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301ec3c-bbc6-44dc-b02d-d85210f9b7b3 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:44.964841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98c4b1-e491-4a5a-8d69-dc852f4fe04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:44.965440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c4b1-e491-4a5a-8d69-dc852f4fe04e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.965715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c4b1-e491-4a5a-8d69-dc852f4fe04e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.965983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c4b1-e491-4a5a-8d69-dc852f4fe04e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.966641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98c4b1-e491-4a5a-8d69-dc852f4fe04e None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:44.966939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98c4b1-e491-4a5a-8d69-dc852f4fe04e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:44.968290 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98c4b1-e491-4a5a-8d69-dc852f4fe04e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:44.976198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 246/497] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:44.977398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0bd0-f8e2-4949-a4a5-39c10beb54ad None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:44.977686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0bd0-f8e2-4949-a4a5-39c10beb54ad None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:44.977963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0bd0-f8e2-4949-a4a5-39c10beb54ad None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:44.979866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 247/498] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:44.980609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e0bd0-f8e2-4949-a4a5-39c10beb54ad None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.000040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427db156-24a3-492b-a658-138901af413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.000675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db156-24a3-492b-a658-138901af413b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.000951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db156-24a3-492b-a658-138901af413b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.001221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db156-24a3-492b-a658-138901af413b None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.001851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db156-24a3-492b-a658-138901af413b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:45.002150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db156-24a3-492b-a658-138901af413b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.003613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db156-24a3-492b-a658-138901af413b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.015657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 252/499] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:45.016926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d378e9-f7f2-4e36-9dd2-88b03e63af7e None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.017211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d378e9-f7f2-4e36-9dd2-88b03e63af7e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.017481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d378e9-f7f2-4e36-9dd2-88b03e63af7e None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.020488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 253/500] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:45.020488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d378e9-f7f2-4e36-9dd2-88b03e63af7e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.050035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.081127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e0bd0-f8e2-4949-a4a5-39c10beb54ad None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.114144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524194-b4a7-4d37-b348-c78623ad9eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.114689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524194-b4a7-4d37-b348-c78623ad9eea None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.114969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524194-b4a7-4d37-b348-c78623ad9eea None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.115241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524194-b4a7-4d37-b348-c78623ad9eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.121087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d378e9-f7f2-4e36-9dd2-88b03e63af7e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.155009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0146005-9652-45d4-9bb6-2f6a0f44abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.155629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146005-9652-45d4-9bb6-2f6a0f44abd4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.155909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146005-9652-45d4-9bb6-2f6a0f44abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.156175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0146005-9652-45d4-9bb6-2f6a0f44abd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.166695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0146005-9652-45d4-9bb6-2f6a0f44abd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.168148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0146005-9652-45d4-9bb6-2f6a0f44abd4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.174794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.181998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524194-b4a7-4d37-b348-c78623ad9eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-f0146005-9652-45d4-9bb6-2f6a0f44abd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:45.183086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:45.184066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:45.185322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:45.185322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:45.185322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:45.185510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524194-b4a7-4d37-b348-c78623ad9eea None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.185579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 254/501] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:45.185579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f3c5-92be-46b8-bb99-aea350d59a9f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.185708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f3c5-92be-46b8-bb99-aea350d59a9f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.185902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f3c5-92be-46b8-bb99-aea350d59a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.203511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5c43f3c5-92be-46b8-bb99-aea350d59a9f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:45.204730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5c43f3c5-92be-46b8-bb99-aea350d59a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:45.255938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.272346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 255/502] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:45.273031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43f3c5-92be-46b8-bb99-aea350d59a9f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.290805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 248/503] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:45.292042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e1a2-eea4-41ae-824d-6a3fc13f0731 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.292343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e1a2-eea4-41ae-824d-6a3fc13f0731 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.292627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e1a2-eea4-41ae-824d-6a3fc13f0731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.310073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cb93e1a2-eea4-41ae-824d-6a3fc13f0731 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:45.311236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cb93e1a2-eea4-41ae-824d-6a3fc13f0731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:45.375294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43f3c5-92be-46b8-bb99-aea350d59a9f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.378264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 249/504] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:45.381273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e1a2-eea4-41ae-824d-6a3fc13f0731 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.402213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.410210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.410849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.411129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.411424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.419063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.420597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:45.433118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:45.434091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:45.435028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 256/505] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:45.435599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.483201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.486102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e1a2-eea4-41ae-824d-6a3fc13f0731 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.523532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.524133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.524437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.524708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.525845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:45.526136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.527494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.534313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b63f96-0d41-48bd-adb6-65082269654d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.538730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 250/506] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:45.539583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.570037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.570681 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.570963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.571229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.581466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.582930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:45.597284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:45.598385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:45.599335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:45.599335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:45.599335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:45.599335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 257/507] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:45.599335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.639571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f773f4c-51f6-445a-920a-3075df800416 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.642933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.673215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc868860-2c26-49a4-8f55-22ae8d75cad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.673835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc868860-2c26-49a4-8f55-22ae8d75cad1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.674111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc868860-2c26-49a4-8f55-22ae8d75cad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.674380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc868860-2c26-49a4-8f55-22ae8d75cad1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.684030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc868860-2c26-49a4-8f55-22ae8d75cad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-fc868860-2c26-49a4-8f55-22ae8d75cad1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:45.689091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:45.690016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:45.690830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 251/508] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:45.691495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc868860-2c26-49a4-8f55-22ae8d75cad1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.703395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cc393-74dc-4a37-99cb-618b6235e2e5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.711946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.736383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.737011 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.737287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.737559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.748651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.750116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:45.764481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:45.765384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:45.766546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:45.766546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:45.766546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:45.766546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 258/509] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:45.766546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.790364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc868860-2c26-49a4-8f55-22ae8d75cad1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.825398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.826008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.826284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.826560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.827286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:45.827587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.829039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.858099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.864873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 252/510] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:45.865684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.866241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81531f-94d7-4aa8-b662-9c79477aa799 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:45.900923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:45.901840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:45.902122 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:45.902395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:45.909534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:45.910967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:45.928859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:45.929827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 259/511] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:45.930730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:45.951908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:45.973618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222490b-66d2-4465-a554-7d81f54d8aa6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.007936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.008568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.008845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.009111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.009741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:46.010040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.011400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.022526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 253/512] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:46.023349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.029206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e1d07-90ec-4482-9d7b-2368a2cfc77a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.062941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.063745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.064051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.064343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.065007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:46.065303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.066658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.074522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 260/513] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:46.075297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.090509 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.126937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f599e-3d59-4b39-aac0-e42b8fc1f723 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.159887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.160451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.160731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.161001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.161637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:46.161939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.163305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.170097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.171737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a6f03-77b4-4491-8902-7dd51cc6d1b2 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.175214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 254/514] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:46.175990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.206135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42554b-ff93-4ef0-9452-a1ea953e8615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.206751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42554b-ff93-4ef0-9452-a1ea953e8615 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.207010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42554b-ff93-4ef0-9452-a1ea953e8615 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.207274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42554b-ff93-4ef0-9452-a1ea953e8615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.272203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e812d6-c6f2-429d-947f-3422d58f647d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.272396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42554b-ff93-4ef0-9452-a1ea953e8615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.273720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42554b-ff93-4ef0-9452-a1ea953e8615 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.287747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.305663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.306761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.307042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.307311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.308064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:46.308395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.309802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.327306 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 255/515] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:46.328097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.372867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 261/516] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:46.373702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42554b-ff93-4ef0-9452-a1ea953e8615 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.384279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.428559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa7d28-a55a-479f-b04d-d0bd6afb52ce None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.461712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.462375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.462795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.463076 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.469630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.471134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.472255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42554b-ff93-4ef0-9452-a1ea953e8615 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:46.483117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:46.484014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:46.484896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 256/517] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:46.485370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.487702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.507853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.508618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.508896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.509166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.520150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.521628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:46.535666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:46.536774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:46.537623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:46.537623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:46.537623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:46.537623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 262/518] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:46.537623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.590182 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7609d72-909d-464e-b761-f270811b9acb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.606666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.623900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc77471-164c-4b0d-accf-1f1faab9563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.624536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc77471-164c-4b0d-accf-1f1faab9563f None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.624822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc77471-164c-4b0d-accf-1f1faab9563f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.625098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc77471-164c-4b0d-accf-1f1faab9563f None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.625786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc77471-164c-4b0d-accf-1f1faab9563f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.627219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc77471-164c-4b0d-accf-1f1faab9563f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.637191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad6e4c-7a07-439d-8618-624ac0d6c19e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.670288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da144-cf04-4cc1-96f2-1618858d5a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.670893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da144-cf04-4cc1-96f2-1618858d5a25 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.671172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da144-cf04-4cc1-96f2-1618858d5a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.671443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da144-cf04-4cc1-96f2-1618858d5a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.704383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.712796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 257/519] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:04:46 2022] POST /identity/v3/users => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:04:46.714500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc77471-164c-4b0d-accf-1f1faab9563f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.747679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141da144-cf04-4cc1-96f2-1618858d5a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.749196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141da144-cf04-4cc1-96f2-1618858d5a25 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.828188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc77471-164c-4b0d-accf-1f1faab9563f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:46.867554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 263/520] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:46.868446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da144-cf04-4cc1-96f2-1618858d5a25 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.869311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:46.870149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:46.870432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:46.870703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:46.884547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:46.886528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:46.901761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:46.902696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:46.903566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:46.903566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:46.903566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:46.903566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 258/521] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:46.904950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:46.933091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.948614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:46.984832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da144-cf04-4cc1-96f2-1618858d5a25 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.012665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f38c2-d53c-4775-8800-1f287e03d1d0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.020704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.021658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.021954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.022249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.023264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:47.023597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.025565 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.049380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 264/522] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:47.049380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.049666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.049666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.049666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.049666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.050001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:47.050001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.051409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.067837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 259/523] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:47.067837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.152119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:47.164478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d5450-a2da-48bf-9e44-36491b2339f1 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.168031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad56c73-8f15-4bda-b3e0-77d8dc153691 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.191061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:47.202492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163942-800a-459c-9688-01f08ad17226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.203260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163942-800a-459c-9688-01f08ad17226 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.203542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163942-800a-459c-9688-01f08ad17226 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.203813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163942-800a-459c-9688-01f08ad17226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.204431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.205038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.205314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.205578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.206221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:47.206510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.207920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.216456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21163942-800a-459c-9688-01f08ad17226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.218543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21163942-800a-459c-9688-01f08ad17226 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.224764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 260/524] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:47.224764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-21163942-800a-459c-9688-01f08ad17226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:47.234370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:47.235428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:47.236288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:47.236288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:47.236288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:47.237364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 265/525] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:47.238179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163942-800a-459c-9688-01f08ad17226 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.336941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af8747-4d3c-4be8-ae8a-20b0628ab023 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.347840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163942-800a-459c-9688-01f08ad17226 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.376903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.377526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.377803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.378920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.378920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=e64f4c342e714597b6c628ca022d7b9a) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:47.379094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.380495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.396347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 261/526] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/role_assignments?user.id=e64f4c342e714597b6c628ca022d7b9a&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:47.396347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.400706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.401569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.401854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.402125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.410711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:47.411378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.412954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:47.426266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:47.427344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:47.428249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 266/527] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:47.428836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.474021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:47.539911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64011e1-1600-4fe5-b575-9549728e700e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.552805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e5fbc-01f7-4ac7-8100-175ffea49700 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.592844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.593839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.594313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.594784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.595567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.596180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.596492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.596769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.597479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:47.597788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.599393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.604371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.606597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.615684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 267/528] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:47.616617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:47.620485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:47.621314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:47.622164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:47.622164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:47.622164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:47.622164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:47.622164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:47.622164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:47.622164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:47.622164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:47.625352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 262/529] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:47.626344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.713988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:47.733787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:47.738084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaedf2a-e4da-4624-90d1-dc8bd7e45c8e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.756808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66a44c-b736-4352-a746-9b07b79d3c6b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.787903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.789146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.789639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.791233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.792576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:47.793080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.794708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.795726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.796394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.796681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.796955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.804046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.806453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.816564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 268/530] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:47.817699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:47.825497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:47.826318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:47.827164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 263/531] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:47.828048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:47.940737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a654aef-7633-421e-8829-735bebf3ca88 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.963564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202c242-9325-4aec-a4f4-eda32538e030 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:47.978322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:47.979025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:47.979237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:47.979510 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:47.980201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:47.980547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:47.981973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:47.997557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:47.999084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 269/532] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:47.999961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:48.007824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a205-8ff3-4eb5-8d0b-41cbd5206e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:48.009764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a205-8ff3-4eb5-8d0b-41cbd5206e88 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.010264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a205-8ff3-4eb5-8d0b-41cbd5206e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.010642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a205-8ff3-4eb5-8d0b-41cbd5206e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.021182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:48.092175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a205-8ff3-4eb5-8d0b-41cbd5206e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:48.093680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a205-8ff3-4eb5-8d0b-41cbd5206e88 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:48.123751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2d52a-8313-4495-9776-9eb285be2b96 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:48.167225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:48.167945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.168291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.168892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.170117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:48.170493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:48.172245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:48.192344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 270/533] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:48.192344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:48.223358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 264/534] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:48.224583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a205-8ff3-4eb5-8d0b-41cbd5206e88 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:48.254555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:48.296404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:48.326798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52df9d-750f-49a7-9cd9-140fae23bd77 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:48.333466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a205-8ff3-4eb5-8d0b-41cbd5206e88 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:48.377907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:48.378515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:48.378891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.378971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.379041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.379109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.379175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.379242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.379318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=fcc7327f524a450e8429b5008166e5d5) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:48.379389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=65afb6f35528480591f2411976470d84) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:48.379457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:48.379523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:48.379597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:48.379667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:48.388332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 271/535] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:48 2022] GET /identity/v3/role_assignments?user.id=65afb6f35528480591f2411976470d84&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:48.388332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:48.389860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 265/536] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:48 2022] GET /identity/v3/role_assignments?user.id=fcc7327f524a450e8429b5008166e5d5&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:48.500580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf9d48-0458-4fac-a7ae-988e669b1bb8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:48.541178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:48.541836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.542110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.542378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.552574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:48.555284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:48.556863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:48.573075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:48.574152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:48.575029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:48.575029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:48.575029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:48.575029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 272/537] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:48.580483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:48.714682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:48.724246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7b860-542c-4c12-9b3f-6aeba2dfabf1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:48.761828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dda24-7ac8-4538-b613-ab2b0a6d1f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:48.762720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dda24-7ac8-4538-b613-ab2b0a6d1f77 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.763147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dda24-7ac8-4538-b613-ab2b0a6d1f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.763563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dda24-7ac8-4538-b613-ab2b0a6d1f77 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.764429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8dda24-7ac8-4538-b613-ab2b0a6d1f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:48.764879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8dda24-7ac8-4538-b613-ab2b0a6d1f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:48.766528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8dda24-7ac8-4538-b613-ab2b0a6d1f77 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:48.780227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 266/538] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:48.786111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:48.812701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf2c1e-7a91-40e4-a697-f906e64c4755 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.813271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf2c1e-7a91-40e4-a697-f906e64c4755 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.813719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf2c1e-7a91-40e4-a697-f906e64c4755 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.815196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 267/539] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:04:48.825776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d23863-9d7a-4caa-b81b-1602a7582118 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:48.826237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d23863-9d7a-4caa-b81b-1602a7582118 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:48.826515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d23863-9d7a-4caa-b81b-1602a7582118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:48.850727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f8d23863-9d7a-4caa-b81b-1602a7582118 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:48.851912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f8d23863-9d7a-4caa-b81b-1602a7582118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:48.965069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a469abc-d270-45f9-8e31-ef9be7c7f4b2 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:48.970884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 268/540] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:49.003423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d23863-9d7a-4caa-b81b-1602a7582118 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:49.005346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:49.005989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.006261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.006526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.015450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:49.016973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:49.030310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:49.031216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:49.032336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 273/541] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:49.037933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:49.113792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:49.169172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be9b59-5583-4a64-9ce7-e646f38f569f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:49.202935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:49.206947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:49.207575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.207856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.208195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.208935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:49.209252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:49.210683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:49.228360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 274/542] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:49.231394 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:49.255410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d23863-9d7a-4caa-b81b-1602a7582118 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:49.343988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1df28-8c3e-49f1-a9db-6717198cfcde None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:49.360297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:49.360499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d1411-95f6-4d5e-9697-997b54014531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:49.361100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d1411-95f6-4d5e-9697-997b54014531 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.361386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d1411-95f6-4d5e-9697-997b54014531 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.361665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d1411-95f6-4d5e-9697-997b54014531 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.383819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:49.384735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.384961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.385251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.386076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=512aab5a19c94651bfa0f634244dbdab) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:49.386387 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:49.387840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:49.398895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 275/543] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:49 2022] GET /identity/v3/role_assignments?user.id=512aab5a19c94651bfa0f634244dbdab&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:49.405156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d1411-95f6-4d5e-9697-997b54014531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-248d1411-95f6-4d5e-9697-997b54014531 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:49.410488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:49.414548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:49.415997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 269/544] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:49.418549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:49.549582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a8851-2955-49e3-acc4-74d986f58eb6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:49.585808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb40402-0f15-4c2e-95d7-37fc6fcf3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:49.586436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb40402-0f15-4c2e-95d7-37fc6fcf3f02 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.586715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb40402-0f15-4c2e-95d7-37fc6fcf3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.586988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb40402-0f15-4c2e-95d7-37fc6fcf3f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.587709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb40402-0f15-4c2e-95d7-37fc6fcf3f02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:49.588011 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb40402-0f15-4c2e-95d7-37fc6fcf3f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:49.589474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb40402-0f15-4c2e-95d7-37fc6fcf3f02 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:49.598831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 276/545] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:49.605081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d1411-95f6-4d5e-9697-997b54014531 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:49.608187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa96919-8c08-4107-9fa5-169bc5bc3c5e None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.608187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa96919-8c08-4107-9fa5-169bc5bc3c5e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.612511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa96919-8c08-4107-9fa5-169bc5bc3c5e None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.612511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 277/546] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:49.615051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a81c5f-881a-49c6-8646-7fd35fcced60 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.615330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a81c5f-881a-49c6-8646-7fd35fcced60 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.615665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a81c5f-881a-49c6-8646-7fd35fcced60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.649388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-70a81c5f-881a-49c6-8646-7fd35fcced60 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:49.651474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-70a81c5f-881a-49c6-8646-7fd35fcced60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:49.697649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:49.742858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 278/547] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:49.779955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d1411-95f6-4d5e-9697-997b54014531 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:49.790851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a81c5f-881a-49c6-8646-7fd35fcced60 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:49.817491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:49.818052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.818328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.818597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:49.829062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:49.830586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:49.832426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:49.846351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:49.847810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:49.848795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:49.848795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:49.848795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:49.848795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 270/548] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:49.853962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:49.943335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a81c5f-881a-49c6-8646-7fd35fcced60 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:49.959505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f933194-b763-42a1-a07d-31c707e44b17 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:49.985065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c41f2-2d55-4db9-bc4a-d2b65909b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:49.985710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c41f2-2d55-4db9-bc4a-d2b65909b945 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:49.985987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c41f2-2d55-4db9-bc4a-d2b65909b945 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:49.986258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c41f2-2d55-4db9-bc4a-d2b65909b945 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:50.010502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c41f2-2d55-4db9-bc4a-d2b65909b945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-e32c41f2-2d55-4db9-bc4a-d2b65909b945 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:50.018098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:50.020441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:50.022689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 279/549] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:50.028330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:50.028330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:50.028330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:50.028330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:50.028992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c41f2-2d55-4db9-bc4a-d2b65909b945 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:50.031632 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:50.032211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:50.033616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:50.059273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 271/550] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:50.067105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:50.084533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:50.141213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:50.166500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c41f2-2d55-4db9-bc4a-d2b65909b945 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:50.187626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beed92-217c-4b7a-ab6a-deb4bb6643f9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:50.205478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:50.206412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:50.206898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:50.207364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:50.208350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:50.208887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:50.210590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:50.220173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 280/551] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:50.229314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:50.231515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:50.233159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:50.233492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:50.233764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:50.253472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:50.254939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:50.282923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:50.284157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:50.285252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 272/552] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:50.291748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:50.336534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:50.347848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790f96-349a-4c11-baf0-459fa6967c5d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:50.389993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:50.391549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:50.392874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:50.393841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:50.416338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:50.420768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:50.446214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:50.447237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:50.448193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:50.448193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:50.448193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:50.450495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 281/553] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:50.464148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:50.497150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb02ec-fa8a-4e88-9610-6b106d99116d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:50.512245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:50.533012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:50.533794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:50.534235 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:50.534654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:50.538418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:50.538418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:50.538418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:50.560689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 273/554] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 11:04:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:50.562197 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:50.637579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d16d-6f71-47fc-b375-8eaefba627e0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:50.666074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888798e-0b1e-41bc-92c9-ea04de05e95f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:50.709654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ce8d9-f614-4fff-b7de-3d63fddee1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:50.710221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:50.710534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce8d9-f614-4fff-b7de-3d63fddee1dd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:50.710926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce8d9-f614-4fff-b7de-3d63fddee1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:50.711287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce8d9-f614-4fff-b7de-3d63fddee1dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:50.711483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:50.711916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:50.712459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:50.713552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:50.714052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:50.715586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:50.729368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 282/555] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:50.735289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:50.738345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:50.819953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:50.873317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ce8d9-f614-4fff-b7de-3d63fddee1dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:50.876948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ce8d9-f614-4fff-b7de-3d63fddee1dd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:50.948379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f61fa-eee3-4f87-ba93-f0dea36cc8ba None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:50.997335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396634a8-e416-41f8-88ae-bcd156a695cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:50.997992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396634a8-e416-41f8-88ae-bcd156a695cc None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:50.998267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396634a8-e416-41f8-88ae-bcd156a695cc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:50.998536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396634a8-e416-41f8-88ae-bcd156a695cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.006821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396634a8-e416-41f8-88ae-bcd156a695cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.009401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396634a8-e416-41f8-88ae-bcd156a695cc None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.017280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 274/556] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:51.018594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc11f-0a03-4742-9487-552cdfb7cf31 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.018877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc11f-0a03-4742-9487-552cdfb7cf31 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.019192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc11f-0a03-4742-9487-552cdfb7cf31 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.020685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 275/557] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:51.022847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc11f-0a03-4742-9487-552cdfb7cf31 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-396634a8-e416-41f8-88ae-bcd156a695cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:51.029305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:51.030730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:51.031951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 283/558] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:04:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:51.036512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3757-c315-4456-92ba-d25523ca5278 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.036933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3757-c315-4456-92ba-d25523ca5278 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.037219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3757-c315-4456-92ba-d25523ca5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.055938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f6fd3757-c315-4456-92ba-d25523ca5278 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:51.057365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f6fd3757-c315-4456-92ba-d25523ca5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:51.098098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.120806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.130188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc11f-0a03-4742-9487-552cdfb7cf31 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.134610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 284/559] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:51.135666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3757-c315-4456-92ba-d25523ca5278 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.167909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.168892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.169348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.169809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.180926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.182583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:51.199911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:51.201083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:51.201969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:51.201969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:51.201969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:51.203804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 276/560] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:51.209238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.253457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3757-c315-4456-92ba-d25523ca5278 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.289409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.290636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.291041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.291313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.292042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:51.292359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.293780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.318545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 285/561] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:51.318545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.326301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776303-439b-4ea2-9dd8-af998b1e4580 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.350221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.361111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281314-616a-4b18-b089-b70691578ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.361782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281314-616a-4b18-b089-b70691578ebf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.362068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281314-616a-4b18-b089-b70691578ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.362326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281314-616a-4b18-b089-b70691578ebf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.371812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.373556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281314-616a-4b18-b089-b70691578ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7e281314-616a-4b18-b089-b70691578ebf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:51.378221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:51.379255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:51.380152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 277/562] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:51.380941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bbbea-f9b5-4c6c-8488-38b8b67e5372 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.380941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bbbea-f9b5-4c6c-8488-38b8b67e5372 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.381579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bbbea-f9b5-4c6c-8488-38b8b67e5372 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.387112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 278/563] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:51.387112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bbbea-f9b5-4c6c-8488-38b8b67e5372 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.437615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843be68-2784-45a2-a526-ac368f555029 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.474025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.474552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.474830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.475101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.475733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:51.476034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.477573 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.495406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 286/564] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:51.495406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.495674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bbbea-f9b5-4c6c-8488-38b8b67e5372 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.532259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7287bf6-f1f0-4876-a586-82e232cfe99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.532951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7287bf6-f1f0-4876-a586-82e232cfe99c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.533195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7287bf6-f1f0-4876-a586-82e232cfe99c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.533449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7287bf6-f1f0-4876-a586-82e232cfe99c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.544789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7287bf6-f1f0-4876-a586-82e232cfe99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.546247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7287bf6-f1f0-4876-a586-82e232cfe99c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f7287bf6-f1f0-4876-a586-82e232cfe99c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:51.562843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:51.563817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:51.565242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:51.565242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:51.565242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:51.565242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 279/565] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:51.569593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc878aee-496a-4c5b-9a73-4aaf8ad2bb36 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.569875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc878aee-496a-4c5b-9a73-4aaf8ad2bb36 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.570146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc878aee-496a-4c5b-9a73-4aaf8ad2bb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.588345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-dc878aee-496a-4c5b-9a73-4aaf8ad2bb36 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:51.589527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dc878aee-496a-4c5b-9a73-4aaf8ad2bb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:51.602142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254c1a-ca44-4f57-b6b3-ed9a63a5db34 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.614626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.622870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.638137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.638743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.639022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.639288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.639946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:51.640241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.641620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.652509 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 287/566] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:51.652509 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.671348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 280/567] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:51.671348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc878aee-496a-4c5b-9a73-4aaf8ad2bb36 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.758400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e546441-766b-4614-a29d-1df4f56a5e52 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.785979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc878aee-496a-4c5b-9a73-4aaf8ad2bb36 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.791683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.792338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.792616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.792886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.799469 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.800924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:51.813676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:51.814607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 288/568] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:51.815518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.827705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.828346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.828633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.828905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.829563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:51.829856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.831223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.843071 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 281/569] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:51.843883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.849511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.872474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:51.916611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91955423-f855-48bc-ac31-f3ccb2ff0a6a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.943691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4694-5994-4ede-a588-2bd2a26fe27d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:51.950101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211308d-d93f-41fb-9984-73fa01dcb230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.950721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211308d-d93f-41fb-9984-73fa01dcb230 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.950995 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211308d-d93f-41fb-9984-73fa01dcb230 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.951261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211308d-d93f-41fb-9984-73fa01dcb230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.961199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211308d-d93f-41fb-9984-73fa01dcb230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:51.962635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211308d-d93f-41fb-9984-73fa01dcb230 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:51.976096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d0f5-16a3-4523-a597-dab6279498ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:51.976736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d0f5-16a3-4523-a597-dab6279498ac None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-f211308d-d93f-41fb-9984-73fa01dcb230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:51.976837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:51.978330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:51.979214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:51.979214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:51.979214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:51.979384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d0f5-16a3-4523-a597-dab6279498ac None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.979384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d0f5-16a3-4523-a597-dab6279498ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.979508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 289/570] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:51.979890 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9c208-e618-4bd1-a638-930ae8a0cff0 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:51.980083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9c208-e618-4bd1-a638-930ae8a0cff0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:51.980379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9c208-e618-4bd1-a638-930ae8a0cff0 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:51.981578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 290/571] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:51.982264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9c208-e618-4bd1-a638-930ae8a0cff0 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:51.994869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122d0f5-16a3-4523-a597-dab6279498ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5122d0f5-16a3-4523-a597-dab6279498ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:51.999525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:52.000756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 282/572] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:52.001606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d0f5-16a3-4523-a597-dab6279498ac None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.069546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:52.085308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9c208-e618-4bd1-a638-930ae8a0cff0 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.089392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:52.104053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d0f5-16a3-4523-a597-dab6279498ac None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.119411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.120018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.120295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.120603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.121293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:52.121594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.123133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.134224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 291/573] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:52.134996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.137718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6e150-4c47-4a85-afa2-b489453406d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.138356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e150-4c47-4a85-afa2-b489453406d7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.138632 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e150-4c47-4a85-afa2-b489453406d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.138902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e150-4c47-4a85-afa2-b489453406d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.145540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6e150-4c47-4a85-afa2-b489453406d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.146982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6e150-4c47-4a85-afa2-b489453406d7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9ad6e150-4c47-4a85-afa2-b489453406d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:52.159190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:52.160166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:52.161567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 283/574] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:52.162156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b191d-3ebf-41c6-a137-e83ed6a0ede7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.162156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b191d-3ebf-41c6-a137-e83ed6a0ede7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.162311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b191d-3ebf-41c6-a137-e83ed6a0ede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.179867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2f2b191d-3ebf-41c6-a137-e83ed6a0ede7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:52.181186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2f2b191d-3ebf-41c6-a137-e83ed6a0ede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:52.238845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81221b2b-e7a9-40f2-a819-21522250ce26 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.245548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 284/575] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:52.246366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b191d-3ebf-41c6-a137-e83ed6a0ede7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.272669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.273277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.273556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.273827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.274992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:52.275297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.276686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.288673 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 292/576] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:52.289448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.295988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:52.326472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:52.349123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b191d-3ebf-41c6-a137-e83ed6a0ede7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.383596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.384509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.384794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.385064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.385728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:52.386026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.387371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.388190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c375ed-77c3-4605-a54d-b7c1595ac346 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.395556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 285/577] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:52.396365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.421623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.422224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.422503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.422771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.423490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=4f582800a7004e78a6fab0038b94cb8b) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:52.423795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.425249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.430423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 293/578] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/role_assignments?user.id=4f582800a7004e78a6fab0038b94cb8b&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:52.431387 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.511302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:52.537704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4ce11-3b49-46f0-b69f-a957659cd02d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.547640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51389af-0227-411b-9c81-27ccb3cf9fce None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.578001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.578215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.578460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.578730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.579474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:52.579787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.581285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.586178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2c1c-0169-4751-bd35-8af179df8ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.586814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2c1c-0169-4751-bd35-8af179df8ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.587978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2c1c-0169-4751-bd35-8af179df8ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.588935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d2c1c-0169-4751-bd35-8af179df8ac8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.593505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:52.599746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d2c1c-0169-4751-bd35-8af179df8ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-042d2c1c-0169-4751-bd35-8af179df8ac8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:52.605028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:52.606033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:52.612178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 294/579] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:52.613120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 286/580] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:52.613120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.613280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2c1c-0169-4751-bd35-8af179df8ac8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.720987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d2c1c-0169-4751-bd35-8af179df8ac8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.724601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79458f7b-1304-4b40-97a9-463a59953c0c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.746298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:52.754601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.755206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.755488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.755761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.761069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.764338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.764338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.764338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.764625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.765440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:52.778417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:52.779521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 11:04:52.780554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:52.781112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.781890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.783264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 295/581] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:52.784211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:52.801434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:52.802411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:52.803287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:52.803287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:52.803287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:52.803287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 287/582] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:52.803287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.863832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:52.902920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52fc7f-d488-4234-851c-6fb3fc60e47a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.923819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c01454-5e8e-4ef4-a9de-0541a094f5ef None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:52.940740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.941353 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.941635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.941907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.942576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:52.942876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.944405 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:52.956707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 296/583] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:52.956707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:52.963781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714c840-a649-4a00-a6e6-621d4d562e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:52.964484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c840-a649-4a00-a6e6-621d4d562e1a None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:52.964773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c840-a649-4a00-a6e6-621d4d562e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:52.965051 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c840-a649-4a00-a6e6-621d4d562e1a None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/e64f4c342e714597b6c628ca022d7b9a/roles/e35eda3b7be4479380b1dbba47f6556f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:52.981951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714c840-a649-4a00-a6e6-621d4d562e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=e64f4c342e714597b6c628ca022d7b9a, role_id=e35eda3b7be4479380b1dbba47f6556f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:52.983394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714c840-a649-4a00-a6e6-621d4d562e1a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.003416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:53.049989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 288/584] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:52 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/e64f4c342e714597b6c628ca022d7b9a/roles/e35eda3b7be4479380b1dbba47f6556f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:53.051050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714c840-a649-4a00-a6e6-621d4d562e1a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.063535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f19b66-da95-4091-bf54-4e14bcc849a3 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.104580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.105661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.106148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.106624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.108461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:53.109057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.111397 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.139242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 297/585] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 11:04:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:53.140287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.179555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:53.182896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714c840-a649-4a00-a6e6-621d4d562e1a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.221201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.222047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.222672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.223041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.223870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:53.224338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.226018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.239225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 289/586] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:53.240072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.276662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53103773-7e5c-422e-8e3f-add774528880 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.296193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:53.325927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.326565 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.326842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.327117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.341227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.343205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.359884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941151-29cd-4a40-8399-adf7d68b9615 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:53.361253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:53.362200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:53.363143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:53.363143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:53.363143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:53.363143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 298/587] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:53.363773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.413255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.415572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.416086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.416588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.430295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.432672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:53.452203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:53.453241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:53.454145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:53.454145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:53.454145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:53.456571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 290/588] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:53.457278 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.476254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:53.494135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a1826-4da3-42f9-a632-975813c0be2a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.532641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.534457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.534987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.535512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.545638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.547540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:53.561683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:53.562682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 11:04:53.563614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:53.570738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8fef8-793f-46e5-a1b7-c229af27ee8b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.571606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 299/589] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:53.572771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.605224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:53.606809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.607683 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.608183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.608674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.609514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:53.609886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.611361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.628491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 291/590] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:53.628491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.702157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:53.715840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245a00d-e514-4aa0-89a3-936e7b86b5a6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.733739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c146e-b1a8-4d51-9653-4f35f1aa9696 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.762028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.763325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.764263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.765073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.766031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:53.766598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.768386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.768684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.769289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.769564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.769834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.770553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:53.770990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.777266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.785827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 300/591] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:53.786901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.801876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 292/592] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:53.801876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.884738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:53.903328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5b673-1a57-4001-a936-050b2835303c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.905247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6eed-1a7e-42a9-a6df-4096837e0177 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:53.934500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:53.941704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.942483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.942841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.943222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.945132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:53.945920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:53.946504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:53.946928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:53.951344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.952982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.954987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:53.956708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:53.965680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:53.967608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:53.968705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 293/593] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:53.969987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:53.972028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:53.972966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 11:04:53.973936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:53.980454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 301/594] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:53.982340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.084771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354e9bd-77d3-470f-a49f-20243d7e007c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.109684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b399-1ec7-4536-944e-057b67f56239 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.122733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.123471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.123845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.124472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.125297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:54.126139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.127914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.141290 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.146148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 302/595] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:54.149846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.159098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.159098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.159098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.159370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.163579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.165731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:54.182844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:54.184012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:54.185121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:54.185121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:54.185121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:54.191211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 294/596] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:54.192247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.254791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.264749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216be7d8-b522-4796-9225-cc1e1ce365ff None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.310559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.311713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.312089 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.312489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.313346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:54.313758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.315846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.327932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6807-cab1-4f4f-84e3-afdb6433103f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.343683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 303/597] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 10 11:04:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:54.343683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.369258 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0d301-2af4-4426-984d-ec5fc7eeb4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.370249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0d301-2af4-4426-984d-ec5fc7eeb4f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.370879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0d301-2af4-4426-984d-ec5fc7eeb4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.371301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0d301-2af4-4426-984d-ec5fc7eeb4f7 None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/65afb6f35528480591f2411976470d84/roles/e35eda3b7be4479380b1dbba47f6556f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.386911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0d301-2af4-4426-984d-ec5fc7eeb4f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=65afb6f35528480591f2411976470d84, role_id=e35eda3b7be4479380b1dbba47f6556f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.388646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0d301-2af4-4426-984d-ec5fc7eeb4f7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.410911 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.451222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0fd83-9a3f-40d4-a156-7e063c7d4b9f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.462546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 295/598] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:54 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/65afb6f35528480591f2411976470d84/roles/e35eda3b7be4479380b1dbba47f6556f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:54.463660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0d301-2af4-4426-984d-ec5fc7eeb4f7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.491515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61afa6-e286-44d5-adb7-a30481c5d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.493744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61afa6-e286-44d5-adb7-a30481c5d08e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.494607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61afa6-e286-44d5-adb7-a30481c5d08e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.495060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61afa6-e286-44d5-adb7-a30481c5d08e None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.496259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61afa6-e286-44d5-adb7-a30481c5d08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:54.497310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61afa6-e286-44d5-adb7-a30481c5d08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.499546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61afa6-e286-44d5-adb7-a30481c5d08e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.519053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 304/599] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:54.520688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f8ba-0afe-43d4-b2dc-dc25eb0d2404 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.521158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f8ba-0afe-43d4-b2dc-dc25eb0d2404 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.521600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4f8ba-0afe-43d4-b2dc-dc25eb0d2404 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.523946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 305/600] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:54.525642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4f8ba-0afe-43d4-b2dc-dc25eb0d2404 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.580995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.593810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0d301-2af4-4426-984d-ec5fc7eeb4f7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.632645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de94a4-41b0-47b1-a677-8ae4c3568a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.633808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de94a4-41b0-47b1-a677-8ae4c3568a9f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.634370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de94a4-41b0-47b1-a677-8ae4c3568a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.634885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de94a4-41b0-47b1-a677-8ae4c3568a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.648585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de94a4-41b0-47b1-a677-8ae4c3568a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.650813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de94a4-41b0-47b1-a677-8ae4c3568a9f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.657603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4f8ba-0afe-43d4-b2dc-dc25eb0d2404 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f6de94a4-41b0-47b1-a677-8ae4c3568a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:54.668403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:54.669377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:54.670891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:54.670891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:54.670891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:54.670891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 296/601] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:54.671133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7256a1-f9f5-403d-9aeb-220f6b47b994 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.671599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7256a1-f9f5-403d-9aeb-220f6b47b994 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.671870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7256a1-f9f5-403d-9aeb-220f6b47b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.683153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.691970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ba7256a1-f9f5-403d-9aeb-220f6b47b994 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:54.693699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ba7256a1-f9f5-403d-9aeb-220f6b47b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:54.705013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.705950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.705950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.706345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.715595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.717507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:54.732577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:54.733500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:54.734416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:54.734416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:54.734416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:54.734416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:54.734416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:54.734416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:54.734416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:54.734416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:54.735387 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 306/602] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:54.737338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.778039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 297/603] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:54.778823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7256a1-f9f5-403d-9aeb-220f6b47b994 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.869600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f76e-6bdf-433c-9578-a96f56f1dea5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.881213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.907824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.908747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.909166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.909601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.910380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:54.910821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.912331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.914320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7256a1-f9f5-403d-9aeb-220f6b47b994 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:54.925981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 307/604] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:54.927120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:54.975403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:54.976030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:54.976341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:54.976626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:54.977361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:54.977667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:54.979177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:54.980046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:54.999900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 298/605] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:55.001211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.046796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b50e4d-2fb8-4f4d-841a-3db726aa506a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:55.083158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c4c0f-d1a1-4b65-a414-792a4c3d0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:55.083792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c4c0f-d1a1-4b65-a414-792a4c3d0095 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.084068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c4c0f-d1a1-4b65-a414-792a4c3d0095 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.084351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c4c0f-d1a1-4b65-a414-792a4c3d0095 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.095200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c4c0f-d1a1-4b65-a414-792a4c3d0095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-0a9c4c0f-d1a1-4b65-a414-792a4c3d0095 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:55.099946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:55.100940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:55.101783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:55.105988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 308/606] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:55.106813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c4c0f-d1a1-4b65-a414-792a4c3d0095 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.118915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ddd68-c4ed-4714-ba64-fffd158f600d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:55.156227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:55.157481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.157963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.158554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.160786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:55.166881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:55.168691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:55.182593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:55.183567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:55.184530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:55.184530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:55.184530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:55.184530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:55.184530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:55.184530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:55.184530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:55.184530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:55.192002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 299/607] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:55.193579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.210120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:55.214496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c4c0f-d1a1-4b65-a414-792a4c3d0095 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:55.249127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec920e-46a3-4612-83fd-662d6c0bab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:55.249789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec920e-46a3-4612-83fd-662d6c0bab5c None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.250073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec920e-46a3-4612-83fd-662d6c0bab5c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.250389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec920e-46a3-4612-83fd-662d6c0bab5c None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/fcc7327f524a450e8429b5008166e5d5/roles/e35eda3b7be4479380b1dbba47f6556f` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.266521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec920e-46a3-4612-83fd-662d6c0bab5c None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=fcc7327f524a450e8429b5008166e5d5, role_id=e35eda3b7be4479380b1dbba47f6556f)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:55.267955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec920e-46a3-4612-83fd-662d6c0bab5c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:55.300548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d1c48-ed1d-42f6-aa6d-98f2c2118dd1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:55.334399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f92d37-d2b6-4352-8404-2c7df0e0b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:55.335206 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f92d37-d2b6-4352-8404-2c7df0e0b5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.335630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f92d37-d2b6-4352-8404-2c7df0e0b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.336041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f92d37-d2b6-4352-8404-2c7df0e0b5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.337036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f92d37-d2b6-4352-8404-2c7df0e0b5a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:55.337496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f92d37-d2b6-4352-8404-2c7df0e0b5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:55.339342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f92d37-d2b6-4352-8404-2c7df0e0b5a9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:55.341357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 309/608] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:55 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/fcc7327f524a450e8429b5008166e5d5/roles/e35eda3b7be4479380b1dbba47f6556f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:55.344517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec920e-46a3-4612-83fd-662d6c0bab5c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.365808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 300/609] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:55.367167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2d19f-fc00-4cc8-bd84-fa5be78717b8 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.367459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2d19f-fc00-4cc8-bd84-fa5be78717b8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.367729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2d19f-fc00-4cc8-bd84-fa5be78717b8 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.374230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 301/610] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:55.374230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2d19f-fc00-4cc8-bd84-fa5be78717b8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.460158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:55.479046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec920e-46a3-4612-83fd-662d6c0bab5c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:55.529501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2d19f-fc00-4cc8-bd84-fa5be78717b8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:55.531811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d81f5-484a-4244-b0bc-4d85bb0e58fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:55.532475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d81f5-484a-4244-b0bc-4d85bb0e58fa None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.532755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d81f5-484a-4244-b0bc-4d85bb0e58fa None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.533026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d81f5-484a-4244-b0bc-4d85bb0e58fa None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.534652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d81f5-484a-4244-b0bc-4d85bb0e58fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:55.534965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d81f5-484a-4244-b0bc-4d85bb0e58fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:55.536984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d81f5-484a-4244-b0bc-4d85bb0e58fa None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:55.556932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 310/611] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:55.558153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d32e-96c0-48f8-9323-2f0af32ea572 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.558398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d32e-96c0-48f8-9323-2f0af32ea572 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.558675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d32e-96c0-48f8-9323-2f0af32ea572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.574389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:55.575022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.575298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.575564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.587949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8a18d32e-96c0-48f8-9323-2f0af32ea572 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:55.588996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:55.590084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8a18d32e-96c0-48f8-9323-2f0af32ea572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:55.590429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:55.593084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:55.606589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:55.607593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:55.608515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:55.608515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:55.608515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:55.612175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 302/612] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:55.613093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.669519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 311/613] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:55.671136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18d32e-96c0-48f8-9323-2f0af32ea572 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.728879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9efd-0ebf-4b18-8e73-113caeb9b6f9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:55.738673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:55.767173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfad0c8-8a96-4d3a-89df-6ec52f873311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:55.767831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad0c8-8a96-4d3a-89df-6ec52f873311 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.768110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad0c8-8a96-4d3a-89df-6ec52f873311 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.768410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad0c8-8a96-4d3a-89df-6ec52f873311 None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/512aab5a19c94651bfa0f634244dbdab/roles/e35eda3b7be4479380b1dbba47f6556f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.775883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18d32e-96c0-48f8-9323-2f0af32ea572 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:55.785991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfad0c8-8a96-4d3a-89df-6ec52f873311 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=512aab5a19c94651bfa0f634244dbdab, role_id=e35eda3b7be4479380b1dbba47f6556f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:55.787513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfad0c8-8a96-4d3a-89df-6ec52f873311 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:55.813604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:55.814231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:55.814583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:55.814926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:55.815665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:55.815967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:55.817381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:55.824778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:55.837406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 312/614] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:55.837406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.850411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 303/615] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:55 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/512aab5a19c94651bfa0f634244dbdab/roles/e35eda3b7be4479380b1dbba47f6556f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:55.851380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfad0c8-8a96-4d3a-89df-6ec52f873311 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:55.976832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f7b27-5267-45cd-8b15-0167a94412d7 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.006011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfad0c8-8a96-4d3a-89df-6ec52f873311 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.021410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204b80-10ec-4e3e-846b-65120492e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:56.022446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204b80-10ec-4e3e-846b-65120492e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.022930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204b80-10ec-4e3e-846b-65120492e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.023425 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204b80-10ec-4e3e-846b-65120492e8c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.040923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00204b80-10ec-4e3e-846b-65120492e8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-00204b80-10ec-4e3e-846b-65120492e8c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:56.047356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:56.048633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:56.049492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:56.052541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 313/616] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:56.061297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204b80-10ec-4e3e-846b-65120492e8c6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.072894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:56.073453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.073729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.074002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.082954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:56.084046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:56.097330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:56.098477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:56.099597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 304/617] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:04:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:56.112017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.136636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:56.153294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:56.202558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204b80-10ec-4e3e-846b-65120492e8c6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.242290 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2084c-7860-4de1-ac54-720c77643d32 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.263774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:56.264431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.264709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.264977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.265644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:56.265939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:56.268150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:56.286859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 314/618] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:56.293119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.333733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:56.334281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.334628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.334830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.335533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:56.335834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:56.343617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:56.374408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 305/619] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:04:56.379538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.419182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1c8cc-b44e-4fa4-bf9e-eb87305b2f4c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.440294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:56.458146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:56.458146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.458146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.458146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.469497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:56.471326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:56.486931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:56.487930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:56.489112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:56.489112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:56.489112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:56.489112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 315/620] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:04:56.497635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.535837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:56.581255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf4ccf-4718-49ba-81df-90c5915e1d04 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.630186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da275f-bd25-40af-a017-09fd58b7e44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:56.631026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da275f-bd25-40af-a017-09fd58b7e44b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.631609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da275f-bd25-40af-a017-09fd58b7e44b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.631890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da275f-bd25-40af-a017-09fd58b7e44b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.645631 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da275f-bd25-40af-a017-09fd58b7e44b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:56.647360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da275f-bd25-40af-a017-09fd58b7e44b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:56.648183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a628b8-5c27-4699-9592-28836fb3598b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-57da275f-bd25-40af-a017-09fd58b7e44b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:56.666921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:56.667931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:56.668867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:56.668867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:56.668867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:56.672462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 306/621] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:56.674790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2c79-ff38-4466-b371-d3318d3659c5 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.675074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2c79-ff38-4466-b371-d3318d3659c5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.675420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2c79-ff38-4466-b371-d3318d3659c5 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.677734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 307/622] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:56.677734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2c79-ff38-4466-b371-d3318d3659c5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.697773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13a8b8-9e2f-4bb6-98f7-0c64650d37b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:56.699162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a8b8-9e2f-4bb6-98f7-0c64650d37b8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.699985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a8b8-9e2f-4bb6-98f7-0c64650d37b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.700600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a8b8-9e2f-4bb6-98f7-0c64650d37b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.701521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13a8b8-9e2f-4bb6-98f7-0c64650d37b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:56.701991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13a8b8-9e2f-4bb6-98f7-0c64650d37b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:56.703963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13a8b8-9e2f-4bb6-98f7-0c64650d37b8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:56.724585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 316/623] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:56.726288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536289-eeef-44ed-bed5-ff3be495c731 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.726710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536289-eeef-44ed-bed5-ff3be495c731 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.727109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536289-eeef-44ed-bed5-ff3be495c731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.750581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f1536289-eeef-44ed-bed5-ff3be495c731 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:56.752471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f1536289-eeef-44ed-bed5-ff3be495c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:56.787088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:56.798331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2c79-ff38-4466-b371-d3318d3659c5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.848095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:56.848095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:56.848095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:56.848095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:56.848583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:56.848583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:56.848583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:56.848583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:56.849354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 317/624] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:56.850931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1536289-eeef-44ed-bed5-ff3be495c731 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.872808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 308/625] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:56.880015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:56.978590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1536289-eeef-44ed-bed5-ff3be495c731 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:56.989034 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9084def-3da9-4cfc-9a5f-924e89c4a298 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.023556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.024828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.025244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.025674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.025809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.026141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.026515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.026842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] PATH_INFO: `/v3/users/nova` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.033937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.035489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.035803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.037570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:57.047725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:57.048881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:57.050015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:57.050015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:57.050015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:57.050015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:57.050015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:57.050015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:57.050015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:57.050015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:57.056346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 309/626] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:57.056346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:57.058515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:57.059436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:04:57.060459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:57.063833 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 318/627] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:04:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:57.065169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:57.098258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:57.116881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:57.172939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0809f-80e2-4d32-90a1-240156d7b9c1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.199336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51681427-093f-49ba-a00f-9ef648b494da None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.210131 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25b03-12f8-4b02-9b6c-2c62168ab4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.210958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25b03-12f8-4b02-9b6c-2c62168ab4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.211592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25b03-12f8-4b02-9b6c-2c62168ab4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.211801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df25b03-12f8-4b02-9b6c-2c62168ab4a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.222418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df25b03-12f8-4b02-9b6c-2c62168ab4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5df25b03-12f8-4b02-9b6c-2c62168ab4a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:57.228475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:57.229607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:57.230582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:57.236677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 310/628] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:57.238611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25b03-12f8-4b02-9b6c-2c62168ab4a2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:57.244460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.245285 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.245714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.246139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.246993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:57.247440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.249498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.270170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 319/629] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:57.270170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:57.369987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df25b03-12f8-4b02-9b6c-2c62168ab4a2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.375895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:57.379969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:57.400439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2801ffc-7ad9-4307-b71f-0fb5a90ca600 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.405942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.406819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.407102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.407376 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.408250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:57.408589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.410014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.432601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 311/630] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:04:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:57.433559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:57.443255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.444667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.445166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.445685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.447501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:57.448301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.459460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.461751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 320/631] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:57.462574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:57.564937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51737315-39c2-42e5-a67d-bc97679c723e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.579674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69098849-5a21-41f5-865c-2ee0d0a1733b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.601805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbf916-63c5-4a55-8f04-03433d01c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.603489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf916-63c5-4a55-8f04-03433d01c4bc None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.603909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf916-63c5-4a55-8f04-03433d01c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.604298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf916-63c5-4a55-8f04-03433d01c4bc None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/4f582800a7004e78a6fab0038b94cb8b/roles/e35eda3b7be4479380b1dbba47f6556f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.622748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbf916-63c5-4a55-8f04-03433d01c4bc None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=4f582800a7004e78a6fab0038b94cb8b, role_id=e35eda3b7be4479380b1dbba47f6556f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.624467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbf916-63c5-4a55-8f04-03433d01c4bc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.626369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1f199-6969-497e-afe6-82f8bff63f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.626994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f199-6969-497e-afe6-82f8bff63f88 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.627280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f199-6969-497e-afe6-82f8bff63f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.627551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1f199-6969-497e-afe6-82f8bff63f88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.642500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:57.690040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 312/632] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:04:57 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/4f582800a7004e78a6fab0038b94cb8b/roles/e35eda3b7be4479380b1dbba47f6556f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:04:57.690679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbf916-63c5-4a55-8f04-03433d01c4bc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:57.707679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1f199-6969-497e-afe6-82f8bff63f88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.710082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1f199-6969-497e-afe6-82f8bff63f88 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.725771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:57.850954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 321/633] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:57.852887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f32909-3b5a-4db6-bb28-25ae6952f345 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.853354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f32909-3b5a-4db6-bb28-25ae6952f345 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.853792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f32909-3b5a-4db6-bb28-25ae6952f345 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.855546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 322/634] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:57.860549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbf916-63c5-4a55-8f04-03433d01c4bc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:57.860887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b49f4-df71-48e1-a53c-8e88df341f05 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.861349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b49f4-df71-48e1-a53c-8e88df341f05 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.861841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b49f4-df71-48e1-a53c-8e88df341f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.884820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-927b49f4-df71-48e1-a53c-8e88df341f05 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:57.885989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-927b49f4-df71-48e1-a53c-8e88df341f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:57.914926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:57.915909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:57.916194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:57.916499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:57.930669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:57.933340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:57.938284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:57.953592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:57.954634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:57.955523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:57.955523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:57.955523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:57.955523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 313/635] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:57.956333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:57.976481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 323/636] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:04:57.976993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b49f4-df71-48e1-a53c-8e88df341f05 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.056329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:58.110789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d909c4-81ae-424a-9bf1-26e5aedcbb23 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.115993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b49f4-df71-48e1-a53c-8e88df341f05 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.156888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.157511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.158120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.158398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.158638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.158757 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.159271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.159375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:58.159587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:58.160049 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.161196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:58.173917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 324/637] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:58.174660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:58.174888 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.176566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:58.196650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:58.197673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:58.198610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:58.198610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:58.198610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:58.202613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 314/638] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:58.203712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.223554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:58.293650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b1301-04af-4689-b6c5-cced97ec4c2c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.309696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6c2a-1ed7-4f79-829d-fa64eb87a51e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.330588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e91316-c4f7-47c5-b2ca-acf4f58bbd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.331153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:58.331265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91316-c4f7-47c5-b2ca-acf4f58bbd67 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.331454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91316-c4f7-47c5-b2ca-acf4f58bbd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.331726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91316-c4f7-47c5-b2ca-acf4f58bbd67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.342880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e91316-c4f7-47c5-b2ca-acf4f58bbd67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:58.345957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e00a-9c75-4abd-8a52-068a71e6a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.346587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e00a-9c75-4abd-8a52-068a71e6a888 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.346865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e00a-9c75-4abd-8a52-068a71e6a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.347137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e00a-9c75-4abd-8a52-068a71e6a888 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-f2e91316-c4f7-47c5-b2ca-acf4f58bbd67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:58.347535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:58.354189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 325/639] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:58.355147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e91316-c4f7-47c5-b2ca-acf4f58bbd67 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.362393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61e00a-9c75-4abd-8a52-068a71e6a888 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:58.363798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61e00a-9c75-4abd-8a52-068a71e6a888 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1e61e00a-9c75-4abd-8a52-068a71e6a888 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:58.375630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:58.376973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 11:04:58.377972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:58.381470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 315/640] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:58.382724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6aad0-bd3e-48a8-b4ae-381fb501e7d9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.383009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6aad0-bd3e-48a8-b4ae-381fb501e7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.383341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6aad0-bd3e-48a8-b4ae-381fb501e7d9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.384759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 316/641] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:58.385444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6aad0-bd3e-48a8-b4ae-381fb501e7d9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.466103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:58.473835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e91316-c4f7-47c5-b2ca-acf4f58bbd67 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.496000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6aad0-bd3e-48a8-b4ae-381fb501e7d9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.509794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.510427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.510690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.510963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.511602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:58.511902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:58.513293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:58.525943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 326/642] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:58.526550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.536949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61530d6-63cf-4203-b5bb-96b101f0dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.537567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61530d6-63cf-4203-b5bb-96b101f0dd1a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.537853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61530d6-63cf-4203-b5bb-96b101f0dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.538122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61530d6-63cf-4203-b5bb-96b101f0dd1a None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.538791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61530d6-63cf-4203-b5bb-96b101f0dd1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:58.539093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61530d6-63cf-4203-b5bb-96b101f0dd1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:58.540650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61530d6-63cf-4203-b5bb-96b101f0dd1a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:58.553283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 317/643] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:58.553283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be890-4e2c-44b0-b9bf-537e1575a800 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.553283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be890-4e2c-44b0-b9bf-537e1575a800 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.553283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be890-4e2c-44b0-b9bf-537e1575a800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.568748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-be7be890-4e2c-44b0-b9bf-537e1575a800 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:04:58.569990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-be7be890-4e2c-44b0-b9bf-537e1575a800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:04:58.606412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:58.637395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7b55-7666-4339-8c7d-93e08848e1d6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.642082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 318/644] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:04:58.650401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7be890-4e2c-44b0-b9bf-537e1575a800 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.675259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.675877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.676159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.676479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.677211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:58.677520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:58.678938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:58.700289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 327/645] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:58.700289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.715183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:58.765181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7be890-4e2c-44b0-b9bf-537e1575a800 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.803202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209dc22-d728-4374-8160-ed89b305d88c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.803388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.803880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.804160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.804461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.811676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:58.813161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:04:58.825469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:58.826513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:58.828001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:04:58.828001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:04:58.828001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:04:58.828001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:04:58.828001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:04:58.828001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:04:58.828001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:04:58.828001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:58.830991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 319/646] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:58.831947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.850234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.851006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.851378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.851779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.863351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:58.863839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:58.865605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:58.881687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:58.882719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:58.884217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:58.884217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:58.884217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:58.884217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 328/647] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:58.884217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:58.945082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3805441-6487-4b23-8d2b-fc81bc9f6df9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.950137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:58.981445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b75d4-214d-45e6-a1bf-e418ccaca71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:58.982116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b75d4-214d-45e6-a1bf-e418ccaca71b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:58.982398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b75d4-214d-45e6-a1bf-e418ccaca71b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:58.982672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b75d4-214d-45e6-a1bf-e418ccaca71b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:58.988241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6982d-1e3f-44cc-b2b4-b7012528f863 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:58.994924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b75d4-214d-45e6-a1bf-e418ccaca71b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-071b75d4-214d-45e6-a1bf-e418ccaca71b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:04:59.000902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:59.001865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 320/648] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:59.008158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b75d4-214d-45e6-a1bf-e418ccaca71b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.023478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49bf44-4f44-4e7d-9721-c25fe5692ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.024642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49bf44-4f44-4e7d-9721-c25fe5692ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.024924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49bf44-4f44-4e7d-9721-c25fe5692ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.025198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49bf44-4f44-4e7d-9721-c25fe5692ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.097815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49bf44-4f44-4e7d-9721-c25fe5692ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.099247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49bf44-4f44-4e7d-9721-c25fe5692ca7 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.103238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.111962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b75d4-214d-45e6-a1bf-e418ccaca71b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.146819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.147429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.147708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.147978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.148725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:59.149577 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.151125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.163581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.165312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 321/649] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:59.165945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.216446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 329/650] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:04:59.217151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49bf44-4f44-4e7d-9721-c25fe5692ca7 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.277775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775bcc4-8145-462b-a5fd-0ce14dcfc20d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.312795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.313414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.313695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.313964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.314605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:59.314905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.316254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.325602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49bf44-4f44-4e7d-9721-c25fe5692ca7 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.329088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 322/651] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:59.329892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.346108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.362867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.363394 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.363679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.363952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.364642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:59.364942 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.366305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.375138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 330/652] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:59.375938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.406296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.438305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3791baa-f732-4f39-aa10-6b8977ee0504 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.473354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.473886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.474164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.474437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.475163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=e64f4c342e714597b6c628ca022d7b9a) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:59.475465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.477436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.483321 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 323/653] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/role_assignments?user.id=e64f4c342e714597b6c628ca022d7b9a&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:59.484354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.484783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66274783-1828-4d42-84eb-28308c6b7b64 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.532371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.533176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.533457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.533727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.546943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.548450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:59.567305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:59.568355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:59.569350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:59.569350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:59.569350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:59.573511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 331/654] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:59.574599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.594889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.627441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7b0e-7a44-4db2-b655-ee0dbfac40ff None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.669546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.670212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.670495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.670790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.679953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.681985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:04:59.694616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:59.695693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:04:59.697275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 324/655] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:59.697874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.795204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.819285 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd371ff-b9dd-4bf1-ae5e-2b2d4420277e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.831495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb5d6f-a31c-45b0-a109-9c8c55010446 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:04:59.855339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094f337-3ebc-441e-82cd-ba79be5fdb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.856129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f337-3ebc-441e-82cd-ba79be5fdb42 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.856543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f337-3ebc-441e-82cd-ba79be5fdb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.856879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f337-3ebc-441e-82cd-ba79be5fdb42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.866484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:04:59.867095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.867369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.868060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094f337-3ebc-441e-82cd-ba79be5fdb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.868181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.868918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:04:59.869221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:04:59.869588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094f337-3ebc-441e-82cd-ba79be5fdb42 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.870552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:04:59.873413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:04:59.887390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 325/656] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:04:59.887390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-2094f337-3ebc-441e-82cd-ba79be5fdb42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:04:59.887664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:04:59.889132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:04:59.890197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:04:59.890197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:04:59.890197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:04:59.891356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 332/657] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:04:59.892556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226725b-1ea3-4c25-9ecd-54426474d18b None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:04:59.892842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226725b-1ea3-4c25-9ecd-54426474d18b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:04:59.893116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226725b-1ea3-4c25-9ecd-54426474d18b None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:04:59.894518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 333/658] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:04:59.895041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226725b-1ea3-4c25-9ecd-54426474d18b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.002225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aebca1-3fff-4b25-b9d0-b9ad5cf8e0d8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.002426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226725b-1ea3-4c25-9ecd-54426474d18b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.032034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.037484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.038148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.045023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.045023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.045023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:00.045023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.045023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.045435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fcbdd-bd28-4153-9934-bfdfe8231f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.045435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fcbdd-bd28-4153-9934-bfdfe8231f4a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.045435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fcbdd-bd28-4153-9934-bfdfe8231f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.045435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fcbdd-bd28-4153-9934-bfdfe8231f4a None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.045728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fcbdd-bd28-4153-9934-bfdfe8231f4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:00.045922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fcbdd-bd28-4153-9934-bfdfe8231f4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.047339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fcbdd-bd28-4153-9934-bfdfe8231f4a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.052044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 334/659] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:00.053071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.066368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 326/660] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 10 11:04:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:00.067656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a0fdd-4910-46a6-9857-76ce3579a2ab None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.067941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a0fdd-4910-46a6-9857-76ce3579a2ab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.068217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a0fdd-4910-46a6-9857-76ce3579a2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.088091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-df5a0fdd-4910-46a6-9857-76ce3579a2ab None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:00.089318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-df5a0fdd-4910-46a6-9857-76ce3579a2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:00.143123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.161714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 327/661] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:05:00.169458 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a0fdd-4910-46a6-9857-76ce3579a2ab None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.170773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0f033-31a2-451c-8f5b-c6a789ed5bdc None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.208079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.208852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.209165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.209513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.216954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.218504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:00.233158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:00.234332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 335/662] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:00.235240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.283882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a0fdd-4910-46a6-9857-76ce3579a2ab None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.292250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.319418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.319983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.320268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.320579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.328471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.330127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:00.343933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:00.344960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 11:05:00.346025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:00.346593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111fdfc-b246-4daf-9d13-30be953671ae None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.346671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 328/663] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:00.346671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.385442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639438-4cd8-47d8-8169-1e7bf62e6484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.386049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639438-4cd8-47d8-8169-1e7bf62e6484 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.386328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639438-4cd8-47d8-8169-1e7bf62e6484 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.387280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e639438-4cd8-47d8-8169-1e7bf62e6484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.399518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.456549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e639438-4cd8-47d8-8169-1e7bf62e6484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.456740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70f2cf-deda-4bd5-8aa3-d169f329bb84 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.457978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e639438-4cd8-47d8-8169-1e7bf62e6484 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.500158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57f7d-4aa9-49d0-a18e-0abf21f255a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.501086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57f7d-4aa9-49d0-a18e-0abf21f255a4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.501371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57f7d-4aa9-49d0-a18e-0abf21f255a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.501650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57f7d-4aa9-49d0-a18e-0abf21f255a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.505884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.515620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce57f7d-4aa9-49d0-a18e-0abf21f255a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-6ce57f7d-4aa9-49d0-a18e-0abf21f255a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:00.521834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:00.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:05:00.524660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:00.531785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 329/664] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:00.531785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57f7d-4aa9-49d0-a18e-0abf21f255a4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.559359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 336/665] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:05:00.564571 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639438-4cd8-47d8-8169-1e7bf62e6484 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.640341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57f7d-4aa9-49d0-a18e-0abf21f255a4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.643563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.671345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e639438-4cd8-47d8-8169-1e7bf62e6484 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.677871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.678487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.678775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.679050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.679747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:00.680141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.682010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.698831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 330/666] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:00.698831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.712870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.713491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.713771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.714159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.715179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:00.715352 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.716760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.736618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 337/667] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:00.737490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.752139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.816495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4f8ba-6ef0-4816-b120-8b3d168561ef None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.846962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357769da-b6bd-4826-83c3-59e1ce1f13cf None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:00.857837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.859486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.860017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.860500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.861585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:00.862492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.864545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.876364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 331/668] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:00.877345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.887577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:00.888214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:00.888525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:00.888804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:00.899416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:00.901037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:00.912085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:00.918966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:00.942843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:00.943862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:00.943862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:00.943862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:00.943862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 338/669] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:00.943862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:00.987124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:00.995102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c025-3ffd-4c17-8b6e-2d6ed49272d1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.029642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c66cdd-99d6-4e77-aab9-e5750f474dd8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.030990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.031851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.032124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.032419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.033155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=65afb6f35528480591f2411976470d84) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:01.033457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.034857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.052341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 332/670] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/role_assignments?user.id=65afb6f35528480591f2411976470d84&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:01.052341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.081496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae848f-6abb-4be1-8954-6518a4ec1717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.082294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae848f-6abb-4be1-8954-6518a4ec1717 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.082752 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae848f-6abb-4be1-8954-6518a4ec1717 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.083092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae848f-6abb-4be1-8954-6518a4ec1717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.158140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:01.162076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae848f-6abb-4be1-8954-6518a4ec1717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.163755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae848f-6abb-4be1-8954-6518a4ec1717 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.169471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14434d5e-116c-4013-8fc0-8baed9b648d5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.213280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.214092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.214867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.214867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.226687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.229208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.230417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:01.247179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:01.248274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:01.249195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:01.249195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:01.249195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:01.249378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 333/671] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:01.251024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.294622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 339/672] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:05:01.296794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae848f-6abb-4be1-8954-6518a4ec1717 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.398355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad6cb8-2811-468e-913c-1bd1a1a38cd8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.424861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae848f-6abb-4be1-8954-6518a4ec1717 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.435671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.436595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.437073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.437561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.438394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:01.438890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.440509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.453932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 334/673] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:01.459172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.463104 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:01.467714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.468348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.468631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.468899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.469675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:01.469987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.471817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.487836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 340/674] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:01.489098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.518797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:01.573932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153078cc-b145-4a6f-bb7b-bf6ae9137ccc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.611116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.612156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.612705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.613199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.625287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.627186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.631097 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44a9c-20bd-4449-821f-f8cc4ad4b07b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:01.643871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:01.645065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:01.645963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:01.645963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:01.645963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:01.648216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 335/675] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:01.649610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.671393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.672020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.672296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.672592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.679842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.682315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:01.693788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:01.694738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 341/676] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:01.696498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.713194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:01.760910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8b291-05d8-43c6-9ee0-448492335c28 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.781700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:01.798798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962601-fd54-48db-8e56-7d2f2485bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.799426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962601-fd54-48db-8e56-7d2f2485bb78 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.799705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962601-fd54-48db-8e56-7d2f2485bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.799975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962601-fd54-48db-8e56-7d2f2485bb78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.801974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d54e-f882-4c0a-a286-cc5a658169f1 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.809342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2962601-fd54-48db-8e56-7d2f2485bb78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.810792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2962601-fd54-48db-8e56-7d2f2485bb78 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e2962601-fd54-48db-8e56-7d2f2485bb78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:01.825102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:01.826139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:01.827089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 336/677] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:01.828348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053a9e-ff5b-4a37-9fa4-b9c8cd71aaae None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.828348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053a9e-ff5b-4a37-9fa4-b9c8cd71aaae None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.828348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef053a9e-ff5b-4a37-9fa4-b9c8cd71aaae None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.829462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 337/678] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:01.829971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef053a9e-ff5b-4a37-9fa4-b9c8cd71aaae None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.851659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.852954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.853167 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.853380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.854016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:01.854313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.855674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:01.873241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 342/679] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:01.873241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:01.945408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef053a9e-ff5b-4a37-9fa4-b9c8cd71aaae None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.959431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:01.978340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4414e-c34d-418c-870a-738917843469 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:01.979817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a401c0-a087-4136-bc45-fa596ef7669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:01.980462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a401c0-a087-4136-bc45-fa596ef7669f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:01.981326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a401c0-a087-4136-bc45-fa596ef7669f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:01.981326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a401c0-a087-4136-bc45-fa596ef7669f None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:01.981680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a401c0-a087-4136-bc45-fa596ef7669f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:01.981978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a401c0-a087-4136-bc45-fa596ef7669f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:01.983374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a401c0-a087-4136-bc45-fa596ef7669f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.001019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 338/680] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:02.001019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432dba-34aa-4400-8b18-c822f1b3e3a9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.001019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432dba-34aa-4400-8b18-c822f1b3e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.001019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432dba-34aa-4400-8b18-c822f1b3e3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.017469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-53432dba-34aa-4400-8b18-c822f1b3e3a9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:02.018635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-53432dba-34aa-4400-8b18-c822f1b3e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:02.019611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.020215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.020524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.020793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.021518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:02.021814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.023217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.033561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:02.045750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 343/681] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 11:05:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:02.045750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.092730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 339/682] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:05:02.093561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53432dba-34aa-4400-8b18-c822f1b3e3a9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.152859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ef5c2-210a-4947-9221-af477fa7d113 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.186724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.187635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.188100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.188606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.195105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.197264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:02.208176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:02.209211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 344/683] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:02.210111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.216341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53432dba-34aa-4400-8b18-c822f1b3e3a9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.219126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:02.252567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.253293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.253573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.254505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.254686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=fcc7327f524a450e8429b5008166e5d5) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:02.254988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.256433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.264083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 340/684] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/role_assignments?user.id=fcc7327f524a450e8429b5008166e5d5&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:02.264974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.286548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:02.340893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e475a1-7403-4c3f-a504-731d24057d07 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.380875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d696d-d22a-4b85-ba4b-7588ef1df4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.381508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d696d-d22a-4b85-ba4b-7588ef1df4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.381789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d696d-d22a-4b85-ba4b-7588ef1df4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.382062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d696d-d22a-4b85-ba4b-7588ef1df4e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.388143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6a5c5-3c16-42ad-9eb8-0baa6914779f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.426609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ce9ac-e353-4aa0-b16d-b65f0619efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.428300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ce9ac-e353-4aa0-b16d-b65f0619efe3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.428809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ce9ac-e353-4aa0-b16d-b65f0619efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.429277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ce9ac-e353-4aa0-b16d-b65f0619efe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.443002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ce9ac-e353-4aa0-b16d-b65f0619efe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-732ce9ac-e353-4aa0-b16d-b65f0619efe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:02.447971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:02.449041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:02.449925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:02.452088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 341/685] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:02.453089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ce9ac-e353-4aa0-b16d-b65f0619efe3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.471310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d696d-d22a-4b85-ba4b-7588ef1df4e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.472859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d696d-d22a-4b85-ba4b-7588ef1df4e5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.485813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:02.547790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:02.589513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ce9ac-e353-4aa0-b16d-b65f0619efe3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.606806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 345/686] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:05:02.610821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d696d-d22a-4b85-ba4b-7588ef1df4e5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.638164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.639217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.639508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.639779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.640787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:02.641102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.642833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.658418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 342/687] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:02.660705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.728096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d696d-d22a-4b85-ba4b-7588ef1df4e5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.766155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.766787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.767067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.767339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.768021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:02.768332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.769758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.780413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 346/688] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:02.781606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.804449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:02.889250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbbb1f-9207-4094-bab6-227bc992d067 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.890864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:02.904065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e4ec3-d2c2-48de-912a-4271039324d3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:02.934413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.935511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.936443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.936862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.938103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=512aab5a19c94651bfa0f634244dbdab) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:02.938558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.940437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:02.941587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:02.942324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:02.942801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:02.943166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:02.952505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 347/689] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/role_assignments?user.id=512aab5a19c94651bfa0f634244dbdab&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:02.956337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:02.958820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:02.960328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:03.006939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:03.008489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:03.009440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:03.009440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:03.009440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:03.011334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 343/690] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:03.033594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.114515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:03.134228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c10a1-7ef6-4692-9940-5ecc2719c68c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.186868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65697b51-f63d-4f10-82c9-65a52d297bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.187512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697b51-f63d-4f10-82c9-65a52d297bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.187785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697b51-f63d-4f10-82c9-65a52d297bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.188050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697b51-f63d-4f10-82c9-65a52d297bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.199746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65697b51-f63d-4f10-82c9-65a52d297bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.204027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65697b51-f63d-4f10-82c9-65a52d297bf6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.207924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4539570-1630-4dbb-a7ab-d621af56ce9f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-65697b51-f63d-4f10-82c9-65a52d297bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:03.219403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:03.220478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:03.221399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:03.221399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:03.221399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:03.221399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 348/691] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:03.221705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf6fc-8b75-4612-9a1c-2f7d878d832e None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.222217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf6fc-8b75-4612-9a1c-2f7d878d832e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.222217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf6fc-8b75-4612-9a1c-2f7d878d832e None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.223568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 349/692] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:03.226237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf6fc-8b75-4612-9a1c-2f7d878d832e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.253236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da425f0c-a3c3-4083-b02c-87c9cf3ca30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.254128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425f0c-a3c3-4083-b02c-87c9cf3ca30c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.254412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425f0c-a3c3-4083-b02c-87c9cf3ca30c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.254680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425f0c-a3c3-4083-b02c-87c9cf3ca30c None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.255320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425f0c-a3c3-4083-b02c-87c9cf3ca30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:03.255616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425f0c-a3c3-4083-b02c-87c9cf3ca30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.257583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425f0c-a3c3-4083-b02c-87c9cf3ca30c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.267112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:03.271611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 344/693] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:03.274559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4bd89-e1cb-4e5c-92df-a0eeb40693a2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.274559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4bd89-e1cb-4e5c-92df-a0eeb40693a2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.274921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4bd89-e1cb-4e5c-92df-a0eeb40693a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.293837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-39a4bd89-e1cb-4e5c-92df-a0eeb40693a2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:03.295020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-39a4bd89-e1cb-4e5c-92df-a0eeb40693a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:03.349702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf6fc-8b75-4612-9a1c-2f7d878d832e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.373361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 345/694] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:05:03.374223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4bd89-e1cb-4e5c-92df-a0eeb40693a2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.399405 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.400021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.400295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.402541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.402652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:03.402937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.404329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.407042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:03.417858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 350/695] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:03.423075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.489038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4bd89-e1cb-4e5c-92df-a0eeb40693a2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.524793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:03.527596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be369c2f-ba7a-4c88-8ccc-4e45d26e7fd4 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.534942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.541978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.541978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.541978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.544963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.546789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:03.560423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:03.561511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:03.562409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:03.562409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:03.562409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:03.562409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:03.562409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:03.562409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:03.562409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:03.562409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:03.564694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 346/696] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:03.565805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.573123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.573873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.574155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.575793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.575793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.576410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:03.591886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:03.593024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:03.593880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:03.596390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 351/697] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:03.597488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.663705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:03.702725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beb0ce-fa6b-473b-8306-65a5de1e1723 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.722367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2d8a-cd0c-4f89-97b5-d37084844510 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.739388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.740088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.740431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.740694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.748622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.750116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.761668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:03.762412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:03.763516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 347/698] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:03.764806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.765560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.765967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.766356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.767274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:03.768135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.769737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.784058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 352/699] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:03.785284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.825179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:03.873828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dc4f-08c9-4afe-9aec-e832ef35b48c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.901838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6640-2307-47f6-9ed2-74589ae0fdc8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:03.910387 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.911219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.911341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.911624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.912262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:03.912597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.914154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.923506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 348/700] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:03.924396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:03.925723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:03.941767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:03.942628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:03.943049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:03.943537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:03.944577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:03.945025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:03.947357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:03.967842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 353/701] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:03.969147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:04.029247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc70a-6004-4a7b-9d9b-5d39d75e8a2c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:04.044294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:04.065047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:04.065688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.065975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.066243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.067147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=4f582800a7004e78a6fab0038b94cb8b) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:04.067450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:04.068904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:04.076550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 349/702] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/role_assignments?user.id=4f582800a7004e78a6fab0038b94cb8b&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:04.077549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:04.082013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1289-acd8-4e8a-ab46-c0a7047a0023 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:04.122327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:04.123242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.123688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.124153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.125019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:04.125464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:04.127129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:04.134415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 354/703] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 11:05:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:04.221961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a3a4-05db-4f7f-afef-f79c8edd3b7a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:04.268817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df510e-96c1-43e4-9ab5-8d99e3abdcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:04.269598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df510e-96c1-43e4-9ab5-8d99e3abdcae None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.270141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df510e-96c1-43e4-9ab5-8d99e3abdcae None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.270508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df510e-96c1-43e4-9ab5-8d99e3abdcae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.329115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:04.356477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df510e-96c1-43e4-9ab5-8d99e3abdcae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:04.358403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df510e-96c1-43e4-9ab5-8d99e3abdcae None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:04.475021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 350/704] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:05:04.480741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:04.528503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:04.590115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5f64-a04c-4f28-84f8-6db86ed5ea67 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:04.593328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ee32-2ead-491f-b7ad-68062bb52cc7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.593615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ee32-2ead-491f-b7ad-68062bb52cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.593886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ee32-2ead-491f-b7ad-68062bb52cc7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.595436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 351/705] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:04.600390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc7f83-0415-4e0f-b581-abb5d8b48f8e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.600672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc7f83-0415-4e0f-b581-abb5d8b48f8e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.600948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc7f83-0415-4e0f-b581-abb5d8b48f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.621059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-62fc7f83-0415-4e0f-b581-abb5d8b48f8e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:04.622239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-62fc7f83-0415-4e0f-b581-abb5d8b48f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:04.636627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:04.637685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.638229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.638700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.656554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:04.658622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:04.681277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:04.682291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:04.683192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:04.683192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:04.683192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:04.693994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 355/706] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:04.694884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:04.695511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 352/707] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:05:04.767056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc7f83-0415-4e0f-b581-abb5d8b48f8e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:04.782731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:04.862855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:04.872679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c9bc2-3af3-41af-ae36-7fba05ec4643 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:04.928472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:04.929108 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:04.929362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:04.930163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:04.930827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:04.931117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:04.933252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:04.946676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc7f83-0415-4e0f-b581-abb5d8b48f8e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:04.947190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 356/708] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:04.953523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:05.003859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:05.004532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.004809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.005072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.019601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:05.021430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:05.039552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:05.041072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:05.042053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:05.042053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:05.042053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:05.042053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 353/709] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:05.046410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:05.141725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:05.162558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42674868-c97c-4dbd-8141-3a903742c20c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:05.192491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a6aea-3334-4207-8a61-f7511fbad159 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:05.202366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:05.203051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.203332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.203599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.210460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:05.212594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:05.223841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:05.224804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:05.225718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 357/710] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:05.230691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:05.237382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:05.238329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.238812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.239301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.240692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:05.241204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:05.243027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:05.256538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 354/711] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:05.262647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:05.265875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:05.399849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477487db-9c00-49c0-b0cd-e655dcbc56dd None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:05.408689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec714ca-90de-48e0-8c06-fc81c97f6dd3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:05.432970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:05.447486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc08431-6954-4dd8-ad58-b86589c5898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:05.447741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303fb8d-0624-47e2-a9f8-8cfde9a24f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:05.448423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fb8d-0624-47e2-a9f8-8cfde9a24f82 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.448668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc08431-6954-4dd8-ad58-b86589c5898d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.448888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fb8d-0624-47e2-a9f8-8cfde9a24f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.448994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fb8d-0624-47e2-a9f8-8cfde9a24f82 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.449426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc08431-6954-4dd8-ad58-b86589c5898d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.449628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303fb8d-0624-47e2-a9f8-8cfde9a24f82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:05.450103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc08431-6954-4dd8-ad58-b86589c5898d None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.450952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc08431-6954-4dd8-ad58-b86589c5898d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:05.451080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303fb8d-0624-47e2-a9f8-8cfde9a24f82 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:05.451521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc08431-6954-4dd8-ad58-b86589c5898d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:05.453120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc08431-6954-4dd8-ad58-b86589c5898d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:05.469772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 358/712] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:05.476049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45712a7-8ee1-418c-bf74-22356d362837 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.476850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45712a7-8ee1-418c-bf74-22356d362837 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.477271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45712a7-8ee1-418c-bf74-22356d362837 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.478884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 359/713] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:05.479756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45712a7-8ee1-418c-bf74-22356d362837 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:05.537798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 355/714] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:05:05 2022] POST /identity/v3/users => generated 254 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:05:05.540778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97786-a107-4bac-ac43-1399bfa17623 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.541182 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97786-a107-4bac-ac43-1399bfa17623 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.541860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97786-a107-4bac-ac43-1399bfa17623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.565695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:05.570315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a1f97786-a107-4bac-ac43-1399bfa17623 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:05.572981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a1f97786-a107-4bac-ac43-1399bfa17623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:05.597420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45712a7-8ee1-418c-bf74-22356d362837 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:05.660250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 356/715] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:05:05.682139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97786-a107-4bac-ac43-1399bfa17623 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:05.684886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:05.685521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.685797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.686064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.687499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=e64f4c342e714597b6c628ca022d7b9a) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:05.687499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:05.688769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:05.703581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 360/716] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:05 2022] GET /identity/v3/role_assignments?user.id=e64f4c342e714597b6c628ca022d7b9a&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:05.845880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97786-a107-4bac-ac43-1399bfa17623 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:05.854916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:05.882981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:05.885765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:05.885765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:05.885765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] PATH_INFO: `/v3/services/network` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:05.885765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:05.886186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:05.897008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:05.898032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:05.899420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 357/717] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:05 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:05.907115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:06.015774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda20148-89c9-453b-822a-89f5aac9ed4a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:06.052589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd6312-e059-4ac1-8e35-4a472c6326d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:06.053203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6312-e059-4ac1-8e35-4a472c6326d6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:06.053483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6312-e059-4ac1-8e35-4a472c6326d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:06.053820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6312-e059-4ac1-8e35-4a472c6326d6 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:06.054455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd6312-e059-4ac1-8e35-4a472c6326d6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:06.054999 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd6312-e059-4ac1-8e35-4a472c6326d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:06.056609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd6312-e059-4ac1-8e35-4a472c6326d6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:06.061305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 361/718] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:06.066713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:06.203985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974dd7-d5d4-470b-8ee1-38d754c1f836 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:06.249316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832571e8-442f-4d68-9a77-3b1c6475d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:06.249928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832571e8-442f-4d68-9a77-3b1c6475d469 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:06.250205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832571e8-442f-4d68-9a77-3b1c6475d469 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:06.250475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832571e8-442f-4d68-9a77-3b1c6475d469 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:06.251111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832571e8-442f-4d68-9a77-3b1c6475d469 None admin] RBAC: Adding query filter params (type=network) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:06.251407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832571e8-442f-4d68-9a77-3b1c6475d469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:06.252794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832571e8-442f-4d68-9a77-3b1c6475d469 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:06.259594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 358/719] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:06.639024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb58cf-16cf-4686-8b62-b4237c396a69 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:06.639404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb58cf-16cf-4686-8b62-b4237c396a69 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:06.639601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb58cf-16cf-4686-8b62-b4237c396a69 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:06.641159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 362/720] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:06.646565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5c38-1ae0-41ef-be74-d91ab07c0614 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:06.646858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5c38-1ae0-41ef-be74-d91ab07c0614 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:06.647140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5c38-1ae0-41ef-be74-d91ab07c0614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:06.666811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fc2c5c38-1ae0-41ef-be74-d91ab07c0614 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:06.668013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fc2c5c38-1ae0-41ef-be74-d91ab07c0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:06.696579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:06.744639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 359/721] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:05:06.763464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb58cf-16cf-4686-8b62-b4237c396a69 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:06.766741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:06.904956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb58cf-16cf-4686-8b62-b4237c396a69 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:06.939416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae7a3b-225d-409e-b702-9f17dbb520cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:06.940032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7a3b-225d-409e-b702-9f17dbb520cc None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:06.940334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7a3b-225d-409e-b702-9f17dbb520cc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:06.940617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7a3b-225d-409e-b702-9f17dbb520cc None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:06.941272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae7a3b-225d-409e-b702-9f17dbb520cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:06.942636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae7a3b-225d-409e-b702-9f17dbb520cc None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:07.050617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 363/722] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:05:06 2022] POST /identity/v3/services => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:05:07.068980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfd60-98b4-4d6b-b69f-d98ef0dcb795 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:07.069651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfd60-98b4-4d6b-b69f-d98ef0dcb795 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:07.069651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfd60-98b4-4d6b-b69f-d98ef0dcb795 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:07.071573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 360/723] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:07.077636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5893a-8bb9-4232-b0eb-09b8c779e9dd None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:07.077948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5893a-8bb9-4232-b0eb-09b8c779e9dd None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:07.078203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5893a-8bb9-4232-b0eb-09b8c779e9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:07.100365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-7fa5893a-8bb9-4232-b0eb-09b8c779e9dd None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:07.101636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7fa5893a-8bb9-4232-b0eb-09b8c779e9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:07.191021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:07.211884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 364/724] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:05:07.248997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cfd60-98b4-4d6b-b69f-d98ef0dcb795 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:07.359836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cfd60-98b4-4d6b-b69f-d98ef0dcb795 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:07.397987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34fd5-5d6e-4a85-b2a4-fe2072dcb185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:07.399151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34fd5-5d6e-4a85-b2a4-fe2072dcb185 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:07.399432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34fd5-5d6e-4a85-b2a4-fe2072dcb185 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:07.399708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34fd5-5d6e-4a85-b2a4-fe2072dcb185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:07.410290 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34fd5-5d6e-4a85-b2a4-fe2072dcb185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-82b34fd5-5d6e-4a85-b2a4-fe2072dcb185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:07.415637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:07.417684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:07.418836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 361/725] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:07.422937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5893a-8bb9-4232-b0eb-09b8c779e9dd None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:07.538286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5893a-8bb9-4232-b0eb-09b8c779e9dd None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:07.579819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:07.580473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:07.580755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:07.581029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:07.581706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:07.582006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:07.583376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:07.593026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 365/726] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:07.598414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34fd5-5d6e-4a85-b2a4-fe2072dcb185 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:07.642952 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:07.749890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34fd5-5d6e-4a85-b2a4-fe2072dcb185 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:07.790971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:07.791522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:07.791798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:07.792069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:07.802753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:07.804193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:07.823137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:07.824207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:07.825166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:07.825166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:07.825166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:07.832341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 362/727] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:07.832494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:07.889645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:07.964118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5be07-6300-4f80-b350-bd4cbff56732 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:08.003478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bb90d-b95a-4df2-a4e6-6f578e3562b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:08.004094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bb90d-b95a-4df2-a4e6-6f578e3562b9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.004447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bb90d-b95a-4df2-a4e6-6f578e3562b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.004716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bb90d-b95a-4df2-a4e6-6f578e3562b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.005417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bb90d-b95a-4df2-a4e6-6f578e3562b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:08.005719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bb90d-b95a-4df2-a4e6-6f578e3562b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:08.007087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bb90d-b95a-4df2-a4e6-6f578e3562b9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:08.026582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 366/728] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:08.032413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:08.127899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:08.152672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc3a6d-2a0e-4f7f-a31d-aa51dff0fe7e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:08.181938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dad79-a2e1-4f7b-9767-ddc3bb0e10b4 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.182472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dad79-a2e1-4f7b-9767-ddc3bb0e10b4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.182472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dad79-a2e1-4f7b-9767-ddc3bb0e10b4 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.184057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 367/729] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:08.188969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f1fb-7a6a-4917-93b2-17627947152f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.189350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f1fb-7a6a-4917-93b2-17627947152f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.189627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1f1fb-7a6a-4917-93b2-17627947152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.193546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039660de-4122-4172-9531-dec73e10a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:08.194227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039660de-4122-4172-9531-dec73e10a72d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.194511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039660de-4122-4172-9531-dec73e10a72d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.194782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039660de-4122-4172-9531-dec73e10a72d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.209614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039660de-4122-4172-9531-dec73e10a72d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:08.211251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039660de-4122-4172-9531-dec73e10a72d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:08.216651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-13d1f1fb-7a6a-4917-93b2-17627947152f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:08.217838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-13d1f1fb-7a6a-4917-93b2-17627947152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-039660de-4122-4172-9531-dec73e10a72d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:08.231828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:08.233018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:05:08.234172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:08.234731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 363/730] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:08.235435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bad0d-c79f-4497-a77c-8df3ebccaa78 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.235720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bad0d-c79f-4497-a77c-8df3ebccaa78 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.235991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bad0d-c79f-4497-a77c-8df3ebccaa78 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.240911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 364/731] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:08.242492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bad0d-c79f-4497-a77c-8df3ebccaa78 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:08.308982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 368/732] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 11:05:08.317709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e3f5d-9cb3-4fa3-ba19-3615e752b0df None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.318223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e3f5d-9cb3-4fa3-ba19-3615e752b0df None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.318675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e3f5d-9cb3-4fa3-ba19-3615e752b0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.345165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-543e3f5d-9cb3-4fa3-ba19-3615e752b0df None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:08.346459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-543e3f5d-9cb3-4fa3-ba19-3615e752b0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:08.364570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bad0d-c79f-4497-a77c-8df3ebccaa78 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:08.389724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:08.402143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:08.402769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.403114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.403428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.404193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:08.404533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:08.409565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:08.409565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:08.428463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 369/734] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:05:08.429357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 365/734] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:08.429713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e3f5d-9cb3-4fa3-ba19-3615e752b0df None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:08.430224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:08.538645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bef35-294a-4c29-97f3-d8cc8a60f178 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:08.552164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e3f5d-9cb3-4fa3-ba19-3615e752b0df None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:08.583217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424ea29-a14a-4783-b10f-e956b2b4bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:08.583843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424ea29-a14a-4783-b10f-e956b2b4bf83 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.584274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424ea29-a14a-4783-b10f-e956b2b4bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.584585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424ea29-a14a-4783-b10f-e956b2b4bf83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.590677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c472d43-cab6-410c-ada5-17d13fb0648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:08.591438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c472d43-cab6-410c-ada5-17d13fb0648d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.591818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c472d43-cab6-410c-ada5-17d13fb0648d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.592187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c472d43-cab6-410c-ada5-17d13fb0648d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.603543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c472d43-cab6-410c-ada5-17d13fb0648d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-8c472d43-cab6-410c-ada5-17d13fb0648d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:08.608856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:08.609793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:08.610650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 370/735] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:08.611367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c472d43-cab6-410c-ada5-17d13fb0648d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:08.649768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:08.657750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:08.666419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424ea29-a14a-4783-b10f-e956b2b4bf83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:08.669279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424ea29-a14a-4783-b10f-e956b2b4bf83 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:08.729088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c472d43-cab6-410c-ada5-17d13fb0648d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:08.764924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7b68-8dab-462c-b2a0-58d88474857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:08.765838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7b68-8dab-462c-b2a0-58d88474857e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.766262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7b68-8dab-462c-b2a0-58d88474857e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.766676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7b68-8dab-462c-b2a0-58d88474857e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.777566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda7b68-8dab-462c-b2a0-58d88474857e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-4cda7b68-8dab-462c-b2a0-58d88474857e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:08.782710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:08.783838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:08.784892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:08.786977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 371/736] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:08.788037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7b68-8dab-462c-b2a0-58d88474857e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:08.804892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 366/737] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 11:05:08.806862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424ea29-a14a-4783-b10f-e956b2b4bf83 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:08.892361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:08.909540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7b68-8dab-462c-b2a0-58d88474857e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:08.913595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:08.920618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424ea29-a14a-4783-b10f-e956b2b4bf83 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:08.939045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:08.939651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.939927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.940223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.940913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:08.941207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:08.947333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:08.951635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 372/738] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:08.952636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:08.959199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e8f3a-384b-4181-8cc5-d299408d1062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:08.959819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e8f3a-384b-4181-8cc5-d299408d1062 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.960099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e8f3a-384b-4181-8cc5-d299408d1062 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.960399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e8f3a-384b-4181-8cc5-d299408d1062 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.961646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e8f3a-384b-4181-8cc5-d299408d1062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:08.962208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e8f3a-384b-4181-8cc5-d299408d1062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:08.963806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e8f3a-384b-4181-8cc5-d299408d1062 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:08.977248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 367/739] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:08.978531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cf99-c10e-4fb8-8555-cd72c3154084 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:08.978821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cf99-c10e-4fb8-8555-cd72c3154084 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:08.979096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5cf99-c10e-4fb8-8555-cd72c3154084 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:08.984289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 368/740] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:08.984289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5cf99-c10e-4fb8-8555-cd72c3154084 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.064440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc50643-ea49-4725-9d60-c9a23e8d60b2 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.083120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5cf99-c10e-4fb8-8555-cd72c3154084 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.099873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.100775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.101897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.102450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.113543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.115323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.115611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d56ef4-2e1b-4a3c-8fc7-0d7a40ebb833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.116234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56ef4-2e1b-4a3c-8fc7-0d7a40ebb833 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.116549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56ef4-2e1b-4a3c-8fc7-0d7a40ebb833 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.116867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56ef4-2e1b-4a3c-8fc7-0d7a40ebb833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.127452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d56ef4-2e1b-4a3c-8fc7-0d7a40ebb833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.128885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d56ef4-2e1b-4a3c-8fc7-0d7a40ebb833 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:09.132602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:09.133724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:09.134865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:09.134865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:09.134865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:09.136392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 373/741] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:09.137449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.142180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c9d56ef4-2e1b-4a3c-8fc7-0d7a40ebb833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:09.147844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:09.149032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:09.149963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:09.149963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:09.149963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:09.149963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 369/742] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:09.150551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98071-02b0-4502-a42f-d0d1e0e40172 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.150655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98071-02b0-4502-a42f-d0d1e0e40172 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.150885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98071-02b0-4502-a42f-d0d1e0e40172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.170005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c8d98071-02b0-4502-a42f-d0d1e0e40172 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:09.171171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c8d98071-02b0-4502-a42f-d0d1e0e40172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:09.173296 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:09.244352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 370/743] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 11:05:09.244352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98071-02b0-4502-a42f-d0d1e0e40172 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.259516 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38554ad1-e72e-4598-977e-df6ed066c5a6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.295852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.296603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.296881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.297150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.308441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.309875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:09.324226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:09.325257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:09.326229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:09.326229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:09.326229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:09.329989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 374/744] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:09.330701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.349357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98071-02b0-4502-a42f-d0d1e0e40172 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.387011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.387622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.387898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.388155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.388722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:09.388855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:09.389154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.390700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.397003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:09.402268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 371/745] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:09.407510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.436523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06bf5e-093d-49da-9d7b-9e6d3e1a27aa None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.474583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.475379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.475822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.476281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.477117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:09.477482 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.479144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.496773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 375/746] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:09.496773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.519837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266d0ab-37f1-44f9-b735-c1a731b242f1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.553708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f30ac-c392-4a0d-ab7e-fba30f0bbc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.555067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f30ac-c392-4a0d-ab7e-fba30f0bbc5d None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.555681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f30ac-c392-4a0d-ab7e-fba30f0bbc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.556095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f30ac-c392-4a0d-ab7e-fba30f0bbc5d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.556951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f30ac-c392-4a0d-ab7e-fba30f0bbc5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.558559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f30ac-c392-4a0d-ab7e-fba30f0bbc5d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.598221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8bbc5-fbb8-4052-a5d3-c7e4b5f86785 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.615253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:09.615645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 372/747] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:05:09 2022] POST /identity/v3/services => generated 240 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:09.616549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f30ac-c392-4a0d-ab7e-fba30f0bbc5d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.653399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.654520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.655053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.655677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.657010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:09.657588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.659164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.674748 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 376/748] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:09.676034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.691286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:09.741560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f30ac-c392-4a0d-ab7e-fba30f0bbc5d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.780225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.780894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.781430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.781699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.790474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.791350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.799270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02e40-f92d-436b-9b3a-2cb7a9fe3319 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:09.803705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:09.805331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:09.806230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 373/749] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:09.807130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.841179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d151fc5-f06d-48d4-abe8-a87d891a6f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.842068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d151fc5-f06d-48d4-abe8-a87d891a6f9a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.842501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d151fc5-f06d-48d4-abe8-a87d891a6f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.842765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d151fc5-f06d-48d4-abe8-a87d891a6f9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.850203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d151fc5-f06d-48d4-abe8-a87d891a6f9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.852214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d151fc5-f06d-48d4-abe8-a87d891a6f9a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-2d151fc5-f06d-48d4-abe8-a87d891a6f9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:09.863306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:09.864368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:09.865358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 377/750] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:05:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:09.865961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765ce96-76ea-416f-a26b-94c87789baa5 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.865961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765ce96-76ea-416f-a26b-94c87789baa5 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.866086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765ce96-76ea-416f-a26b-94c87789baa5 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.871807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 378/751] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:09.871807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765ce96-76ea-416f-a26b-94c87789baa5 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:09.909009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:09.925314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ce928-6eff-4215-86f9-27b1071c32a7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.944146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:09.961018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732ef34-92c8-473d-a2ea-7986373c9719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:09.961829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ef34-92c8-473d-a2ea-7986373c9719 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.962111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ef34-92c8-473d-a2ea-7986373c9719 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.962383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ef34-92c8-473d-a2ea-7986373c9719 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:09.969970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732ef34-92c8-473d-a2ea-7986373c9719 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:09.971398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732ef34-92c8-473d-a2ea-7986373c9719 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:09.982152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765ce96-76ea-416f-a26b-94c87789baa5 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5732ef34-92c8-473d-a2ea-7986373c9719 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:09.983478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:09.984488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:09.985441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:09.989725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 374/752] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:05:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:09.990764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2b77-1a56-4fc3-a91d-0fba2bf62efe None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:09.991050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2b77-1a56-4fc3-a91d-0fba2bf62efe None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:09.991325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f2b77-1a56-4fc3-a91d-0fba2bf62efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.009481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8d5f2b77-1a56-4fc3-a91d-0fba2bf62efe None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:10.010678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8d5f2b77-1a56-4fc3-a91d-0fba2bf62efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:10.023968 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:10.024606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:10.024882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:10.025151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.025846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:10.026143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:10.027559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:10.039595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 379/753] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:10.040335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.084259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 375/754] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:10.093213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f2b77-1a56-4fc3-a91d-0fba2bf62efe None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.144693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:10.156499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b522f-6377-4ae3-a961-bb07417b9e68 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:10.196784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:10.197244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:10.197523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:10.197795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.198521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:10.198823 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:10.200350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:10.218525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 380/755] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:10.219416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.235472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f2b77-1a56-4fc3-a91d-0fba2bf62efe None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:10.246334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:10.272172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:10.272819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:10.273151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:10.273423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.274160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:10.274458 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:10.276339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:10.299359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 376/756] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:10.299359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.355398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4765c03-1dd1-46d3-a52f-0ef235c28b08 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:10.411697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:10.412429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:10.412792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:10.413124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.413978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=4f582800a7004e78a6fab0038b94cb8b) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:10.414346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:10.415832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:10.417636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a66bb-e902-4990-9bfe-c34d02650107 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:10.421657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 381/757] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/role_assignments?user.id=4f582800a7004e78a6fab0038b94cb8b&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:10.422625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.474486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:10.509540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:10.510208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:10.510492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:10.510936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.519349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:10.520911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:10.537159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:10.538572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:10.539927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 377/758] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:10.540934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.618007 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:10.642131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f861-69ac-4571-ac1b-dfa102750bb9 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:10.680325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9248a-c27e-4541-886b-42e775120f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:10.681340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9248a-c27e-4541-886b-42e775120f2a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:10.681816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9248a-c27e-4541-886b-42e775120f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:10.682302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9248a-c27e-4541-886b-42e775120f2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.692657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5876313-5ddd-4197-a33c-e88679c0ad0a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:10.729974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:10.730528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:10.730804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:10.731072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.742744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:10.744184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:10.759540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9248a-c27e-4541-886b-42e775120f2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:10.759997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:10.761008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:10.761898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:10.761898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:10.761898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:10.764075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9248a-c27e-4541-886b-42e775120f2a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:10.766017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 378/759] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:10.767131 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.782227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:10.857103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:10.877171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd413-d93c-441f-97cc-6d46b559d80c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:10.880792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 382/760] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:10.881947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9248a-c27e-4541-886b-42e775120f2a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.919640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:10.920251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:10.920564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:10.920834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:10.921466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:10.921766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:10.924299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:10.929720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 379/761] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:10.931185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:10.991643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9248a-c27e-4541-886b-42e775120f2a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.007542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:11.026184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.030862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.030862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.030862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.030862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:11.030862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.030862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.039385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed281f2-9159-4abf-b512-ca0893fd0be6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.047324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 383/762] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:11.048393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.075313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.075951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.076233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.076538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.087728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.089274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.096417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:11.105620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:11.113456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:11.114589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:11.114589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:11.114589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:11.114589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 380/763] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:11.115029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.153991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1d4ee-0938-460d-941a-60feb024ed5c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.189711 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.190838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.190838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.191164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.191886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:11.192286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.193837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.204540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 384/764] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:11.204540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.229750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81259a72-b086-4352-9866-03f0d9d0c856 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.244764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:11.266248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.267453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.267882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.268489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.277139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.278787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:11.290889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:11.291918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:11.292885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:11.292885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:11.292885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:11.292885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:11.292885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:11.292885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:11.292885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:11.292885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:11.295190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 381/765] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:11.296213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.311612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cce77b-51f2-4da0-b708-dcf46decd46f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.347685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.348427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.348778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.349120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.349830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:11.350207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.352249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.360957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:11.370389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 385/766] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:11.370389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.409966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71006419-0b9b-4d24-ab86-c56789f57d3b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.445788 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.446706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.447188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.447669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.448672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] RBAC: Adding query filter params (interface=public, service_id=0ec13ec608d941eb82d3850f276cd01d, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:11.449203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.450832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.464590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 382/767] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/endpoints?service_id=0ec13ec608d941eb82d3850f276cd01d&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:11.465782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.472925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243dda4-5997-4339-98b3-d3323eee0973 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.506875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:11.510956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.511614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.511896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.512167 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.512914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:11.513388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.514863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.532776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 386/768] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:11.533995 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.573966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d129b-2bb8-42c9-9fec-173568feaf39 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.598093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:11.611292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.612288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.612768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.624918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.624918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.624918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:11.634218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:11.635349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:11.636651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:11.636651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:11.636651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:11.636651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:11.636651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:11.636651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:11.636651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:11.636651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:11.638077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 383/769] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:11.643294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.652701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89714f38-6e17-47ce-91d3-c4b2978b9e27 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.695923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc68a7-6b72-4089-a4ec-f053a3c7917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.696563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc68a7-6b72-4089-a4ec-f053a3c7917f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.696841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc68a7-6b72-4089-a4ec-f053a3c7917f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.697109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc68a7-6b72-4089-a4ec-f053a3c7917f None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.697714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc68a7-6b72-4089-a4ec-f053a3c7917f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.699070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc68a7-6b72-4089-a4ec-f053a3c7917f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.712340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 387/770] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:11.712340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc68a7-6b72-4089-a4ec-f053a3c7917f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.734688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:11.786790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35133f6-eeb2-44d0-9a4d-e2d78f06c7ab None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.825845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc68a7-6b72-4089-a4ec-f053a3c7917f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:11.839548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb910a2-041d-4ed4-8778-3e66d93ce9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.840552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb910a2-041d-4ed4-8778-3e66d93ce9a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.840837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb910a2-041d-4ed4-8778-3e66d93ce9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.841116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb910a2-041d-4ed4-8778-3e66d93ce9a2 None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/e64f4c342e714597b6c628ca022d7b9a/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.844147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb910a2-041d-4ed4-8778-3e66d93ce9a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=e64f4c342e714597b6c628ca022d7b9a, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.846302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb910a2-041d-4ed4-8778-3e66d93ce9a2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.865218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497350e5-dbc2-409e-a166-5166bbdd96e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:11.865834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497350e5-dbc2-409e-a166-5166bbdd96e2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.866110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497350e5-dbc2-409e-a166-5166bbdd96e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.866433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497350e5-dbc2-409e-a166-5166bbdd96e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.867498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497350e5-dbc2-409e-a166-5166bbdd96e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:11.867863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497350e5-dbc2-409e-a166-5166bbdd96e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:11.869338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497350e5-dbc2-409e-a166-5166bbdd96e2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:11.881770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 388/771] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:11.883090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f000-ebfa-4f7b-8235-5a05c2dc0fb9 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.883478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f000-ebfa-4f7b-8235-5a05c2dc0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.883875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5f000-ebfa-4f7b-8235-5a05c2dc0fb9 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.885471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 389/772] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:11.888738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5f000-ebfa-4f7b-8235-5a05c2dc0fb9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:11.943380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 384/773] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:05:11 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/e64f4c342e714597b6c628ca022d7b9a/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:05:11.945471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e0f1-3811-49a0-ae94-1077f541d545 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:11.945758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e0f1-3811-49a0-ae94-1077f541d545 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:11.946331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6e0f1-3811-49a0-ae94-1077f541d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:11.985814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-60d6e0f1-3811-49a0-ae94-1077f541d545 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:11.987043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-60d6e0f1-3811-49a0-ae94-1077f541d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:12.024889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:12.055493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:12.087610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5f000-ebfa-4f7b-8235-5a05c2dc0fb9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:12.120545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 385/774] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:12.152117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:12.152777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:12.153060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:12.153336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:12.154074 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=b609ab814003472c9579134a5c91ab37) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:12.154388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:12.155889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:12.157619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6e0f1-3811-49a0-ae94-1077f541d545 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:12.164139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 390/775] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:11 2022] GET /identity/v3/role_assignments?user.id=b609ab814003472c9579134a5c91ab37&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:12.285529 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6e0f1-3811-49a0-ae94-1077f541d545 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:12.330945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874ec70-3737-4585-9f75-ec383d7d7165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:12.331531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874ec70-3737-4585-9f75-ec383d7d7165 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:12.331816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874ec70-3737-4585-9f75-ec383d7d7165 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:12.332094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874ec70-3737-4585-9f75-ec383d7d7165 None admin] PATH_INFO: `/v3/services/network` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:12.332729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874ec70-3737-4585-9f75-ec383d7d7165 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:12.334101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874ec70-3737-4585-9f75-ec383d7d7165 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4874ec70-3737-4585-9f75-ec383d7d7165 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:12.344481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:12.346805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:12.348767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 386/776] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:12 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:12.353136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:12.520508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c26d-d6a3-4df1-9c92-9d04c9571494 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:12.566948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfff74-e913-4676-9b3c-e8a6e8e13b5e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:12.567300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfff74-e913-4676-9b3c-e8a6e8e13b5e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:12.567513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfff74-e913-4676-9b3c-e8a6e8e13b5e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:12.570361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 387/777] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:12.572356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:12.573229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:12.573506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:12.573776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:12.574408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] RBAC: Adding query filter params (name=network) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:12.574706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:12.575481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6102-a0c3-4021-9a24-36ae4b62bdd9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:12.575968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6102-a0c3-4021-9a24-36ae4b62bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:12.576085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:12.576598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6102-a0c3-4021-9a24-36ae4b62bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:12.586513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 391/778] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:12.591520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:12.602567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d8eb6102-a0c3-4021-9a24-36ae4b62bdd9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:12.603951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d8eb6102-a0c3-4021-9a24-36ae4b62bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:12.613396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:12.666408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:12.724876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 388/779] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:12.748257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6102-a0c3-4021-9a24-36ae4b62bdd9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:12.819106 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebe819-1674-4c3a-9fd8-3f9c9c901eae None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:12.860048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6102-a0c3-4021-9a24-36ae4b62bdd9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:12.898864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:12.899480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:12.899760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:12.900023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:12.900686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] RBAC: Adding query filter params (type=network) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:12.900985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:12.904144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:12.916786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007e741-82ca-4cce-b216-288cee00a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:12.917497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e741-82ca-4cce-b216-288cee00a159 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:12.917778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e741-82ca-4cce-b216-288cee00a159 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:12.918052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e741-82ca-4cce-b216-288cee00a159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:12.918397 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 392/780] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:12.921791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:12.941674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007e741-82ca-4cce-b216-288cee00a159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5007e741-82ca-4cce-b216-288cee00a159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:12.951795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:12.952807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:12.953676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:12.958137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 389/781] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:12.959908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007e741-82ca-4cce-b216-288cee00a159 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:12.991088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:13.090809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:13.118548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38b9ff-1fd4-4da2-862c-d51daba9935a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:13.126444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007e741-82ca-4cce-b216-288cee00a159 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:13.155389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:13.156261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:13.156577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:13.156850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:13.157549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] RBAC: Adding query filter params (interface=public, service_id=a460b9747f814adea981f3fb67f9a4c6, region_id=RegionOne) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:13.157857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:13.159221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:13.167790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 393/782] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 11:05:12 2022] GET /identity/v3/endpoints?service_id=a460b9747f814adea981f3fb67f9a4c6&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:13.178866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:13.213013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:13.213637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:13.213917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:13.214190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:13.214872 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:13.215174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:13.216556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:13.231700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 390/783] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:13.241637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:13.291272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c63f7-aed3-4244-8e95-12193fbedb0d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:13.326832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6b4b-7f58-4de2-8ae3-1145296cb2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:13.327446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6b4b-7f58-4de2-8ae3-1145296cb2ee None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:13.327724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6b4b-7f58-4de2-8ae3-1145296cb2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:13.327997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b6b4b-7f58-4de2-8ae3-1145296cb2ee None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:13.328639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b6b4b-7f58-4de2-8ae3-1145296cb2ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:13.330127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b6b4b-7f58-4de2-8ae3-1145296cb2ee None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:13.336194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 394/784] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:05:13 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:13.412590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:13.432737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8641-67c6-4ff2-a65a-47068cf42ad1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:13.503619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:13.504282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:13.504582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:13.504854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:13.521123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:13.522590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:13.542920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:13.543966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:13.545518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:13.545518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:13.545518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:13.545518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 391/785] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:13.549771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6b4b-7f58-4de2-8ae3-1145296cb2ee None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:13.554934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:13.666044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b6b4b-7f58-4de2-8ae3-1145296cb2ee None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:13.711032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:13.712039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:13.712564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:13.713053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:13.713900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:13.714437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:13.716029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:13.730678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 395/786] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:13.735895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:13.890778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26210c6-81f4-4de3-af8e-de49663fb9df None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:13.932690 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e98c74-cdf4-4b7a-b620-9e7472148cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:13.933690 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98c74-cdf4-4b7a-b620-9e7472148cbe None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:13.934173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98c74-cdf4-4b7a-b620-9e7472148cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:13.934678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98c74-cdf4-4b7a-b620-9e7472148cbe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:13.946622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e98c74-cdf4-4b7a-b620-9e7472148cbe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:13.948389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e98c74-cdf4-4b7a-b620-9e7472148cbe None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:13.954842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-02e98c74-cdf4-4b7a-b620-9e7472148cbe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:13.965021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:13.966045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:05:13.966992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:13.969312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 392/787] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:13.974847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.045474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:14.089574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be62db8-c25c-42e0-8345-461c03a58330 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:14.130789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a531a-c0d4-4e75-b21f-c189ae958021 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.131102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a531a-c0d4-4e75-b21f-c189ae958021 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.131339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a531a-c0d4-4e75-b21f-c189ae958021 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.132920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 393/788] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:14.138195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc17dde-2080-4983-b8db-d69d82929f14 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.138769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc17dde-2080-4983-b8db-d69d82929f14 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.139266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc17dde-2080-4983-b8db-d69d82929f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.143195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:14.143813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.144093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.152402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.152402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:14.152402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:14.152402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:14.166852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 396/789] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 11:05:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:14.169976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2bc17dde-2080-4983-b8db-d69d82929f14 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:14.171678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2bc17dde-2080-4983-b8db-d69d82929f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:14.172203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.293822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 394/790] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:14.324334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b625ac-d27c-4634-a844-b0d4abc0da5b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:14.337833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc17dde-2080-4983-b8db-d69d82929f14 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.371844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:14.385294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc19acd-8d38-49c0-92bc-b2f60145e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:14.385934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19acd-8d38-49c0-92bc-b2f60145e123 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.386212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19acd-8d38-49c0-92bc-b2f60145e123 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.386484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19acd-8d38-49c0-92bc-b2f60145e123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.409738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc19acd-8d38-49c0-92bc-b2f60145e123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:14.411713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc19acd-8d38-49c0-92bc-b2f60145e123 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-5dc19acd-8d38-49c0-92bc-b2f60145e123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:14.429643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:14.430726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:14.431666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:14.431666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:14.431666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:14.431666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 397/791] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:14.436627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bb228-ba76-45cd-a731-deadcf1b24f2 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.437030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bb228-ba76-45cd-a731-deadcf1b24f2 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.437322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bb228-ba76-45cd-a731-deadcf1b24f2 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.439051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 398/792] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:14.440556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bb228-ba76-45cd-a731-deadcf1b24f2 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.485200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc17dde-2080-4983-b8db-d69d82929f14 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:14.521468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:14.528287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae014721-399d-40a8-86a1-a2a1893ad412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:14.529179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014721-399d-40a8-86a1-a2a1893ad412 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.529604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014721-399d-40a8-86a1-a2a1893ad412 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.530017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014721-399d-40a8-86a1-a2a1893ad412 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.530801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae014721-399d-40a8-86a1-a2a1893ad412 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:14.532642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae014721-399d-40a8-86a1-a2a1893ad412 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ae014721-399d-40a8-86a1-a2a1893ad412 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:14.542388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:14.543718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 11:05:14.544833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:14.547211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 395/793] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 10 11:05:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:14.548646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db99875-d973-4f3d-ad1f-2375eef852f3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.549125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db99875-d973-4f3d-ad1f-2375eef852f3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.549556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db99875-d973-4f3d-ad1f-2375eef852f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.555142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bb228-ba76-45cd-a731-deadcf1b24f2 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:14.569751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3db99875-d973-4f3d-ad1f-2375eef852f3 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:14.571351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3db99875-d973-4f3d-ad1f-2375eef852f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:14.596762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:14.597389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.597670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.597939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.598855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:14.599160 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:14.600749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:14.619499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 399/794] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:14.619499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.656627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 396/795] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:14.657886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db99875-d973-4f3d-ad1f-2375eef852f3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.672377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:14.739531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147e90-ed8f-4c9d-86bd-8a4dfce49914 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:14.771132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db99875-d973-4f3d-ad1f-2375eef852f3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:14.785251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:14.785559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.786276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.786559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.787464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:14.787771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:14.789687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:14.795312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:14.795775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 400/796] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 11:05:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:14.796892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.806528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9f9d5-624b-425a-bf01-567630594139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:14.807160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9f9d5-624b-425a-bf01-567630594139 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.807433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9f9d5-624b-425a-bf01-567630594139 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.807703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9f9d5-624b-425a-bf01-567630594139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.814501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9f9d5-624b-425a-bf01-567630594139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:14.815922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9f9d5-624b-425a-bf01-567630594139 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-57b9f9d5-624b-425a-bf01-567630594139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:14.827799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:14.828901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 397/797] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf36c-4ba6-4b84-b122-8b441c46d770 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.834771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf36c-4ba6-4b84-b122-8b441c46d770 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.835378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bf36c-4ba6-4b84-b122-8b441c46d770 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.836138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 398/798] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:14.837225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bf36c-4ba6-4b84-b122-8b441c46d770 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.907817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:14.915381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87884-c6f5-40e9-bcb4-607786db26b7 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:14.943147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bf36c-4ba6-4b84-b122-8b441c46d770 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:14.951890 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc648-8050-4590-95cd-723679845234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:14.952654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc648-8050-4590-95cd-723679845234 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.952928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc648-8050-4590-95cd-723679845234 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.953194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdc648-8050-4590-95cd-723679845234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.964679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdc648-8050-4590-95cd-723679845234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-45cdc648-8050-4590-95cd-723679845234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:14.969837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:14.970982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:14.971933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 401/799] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:14.972766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc648-8050-4590-95cd-723679845234 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:14.984203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feedc88-f783-4c3b-8948-c0c0f777b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:14.984860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feedc88-f783-4c3b-8948-c0c0f777b93e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.985143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feedc88-f783-4c3b-8948-c0c0f777b93e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.985414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feedc88-f783-4c3b-8948-c0c0f777b93e None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:14.986047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feedc88-f783-4c3b-8948-c0c0f777b93e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:14.986348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feedc88-f783-4c3b-8948-c0c0f777b93e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:14.987691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feedc88-f783-4c3b-8948-c0c0f777b93e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:14.992604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 399/800] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 10 11:05:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:14.993720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a82e-104c-4f8f-bb57-8e1fe1faa4ed None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:14.993998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a82e-104c-4f8f-bb57-8e1fe1faa4ed None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:14.994265 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8a82e-104c-4f8f-bb57-8e1fe1faa4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.012415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-efa8a82e-104c-4f8f-bb57-8e1fe1faa4ed None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:15.013519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-efa8a82e-104c-4f8f-bb57-8e1fe1faa4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:15.058210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:15.092333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 400/801] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:15.092333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8a82e-104c-4f8f-bb57-8e1fe1faa4ed None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.095111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdc648-8050-4590-95cd-723679845234 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:15.130375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:15.131132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.131408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.131678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.132939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:15.133249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:15.134670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:15.146439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 402/802] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:15.147131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.165996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:15.198266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8a82e-104c-4f8f-bb57-8e1fe1faa4ed None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:15.234242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428442bd-e263-4990-8e92-5efad206444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:15.234950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428442bd-e263-4990-8e92-5efad206444a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.235234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428442bd-e263-4990-8e92-5efad206444a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.235504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428442bd-e263-4990-8e92-5efad206444a None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.236175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428442bd-e263-4990-8e92-5efad206444a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:15.236506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428442bd-e263-4990-8e92-5efad206444a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:15.237861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428442bd-e263-4990-8e92-5efad206444a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:15.246771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 401/803] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:15.247945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428442bd-e263-4990-8e92-5efad206444a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.253546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28d5fe-0d0f-48c7-8daf-ac9497581e09 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:15.289500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a304b97-d51f-46a5-b0f3-e785627e846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:15.290112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304b97-d51f-46a5-b0f3-e785627e846c None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.290389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304b97-d51f-46a5-b0f3-e785627e846c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.290654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a304b97-d51f-46a5-b0f3-e785627e846c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.291300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a304b97-d51f-46a5-b0f3-e785627e846c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:15.292685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a304b97-d51f-46a5-b0f3-e785627e846c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:15.294440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:15.352035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428442bd-e263-4990-8e92-5efad206444a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:15.384267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fda41-4b1a-4439-9b26-ba223317080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:15.384932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fda41-4b1a-4439-9b26-ba223317080d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.385213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fda41-4b1a-4439-9b26-ba223317080d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.385478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fda41-4b1a-4439-9b26-ba223317080d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.392945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 403/804] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:05:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:15.395737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fda41-4b1a-4439-9b26-ba223317080d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:15.401634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a304b97-d51f-46a5-b0f3-e785627e846c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-707fda41-4b1a-4439-9b26-ba223317080d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:15.401808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:15.402803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:05:15.403657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:15.407955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 402/805] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:05:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:15.410454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fda41-4b1a-4439-9b26-ba223317080d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.518333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:15.548084 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:15.557342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fda41-4b1a-4439-9b26-ba223317080d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:15.570712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a304b97-d51f-46a5-b0f3-e785627e846c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:15.609141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:15.609718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.610066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.610407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.618361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4450d6-242e-418b-862e-46d581e03fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:15.618361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4450d6-242e-418b-862e-46d581e03fc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.618657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4450d6-242e-418b-862e-46d581e03fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.619026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4450d6-242e-418b-862e-46d581e03fc3 None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/4f582800a7004e78a6fab0038b94cb8b/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.621991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4450d6-242e-418b-862e-46d581e03fc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=4f582800a7004e78a6fab0038b94cb8b, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:15.622642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:15.623616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4450d6-242e-418b-862e-46d581e03fc3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:15.624069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:15.642774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:15.643970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:15.645165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:15.645165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:15.645165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:15.646888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 403/806] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:15.648043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.691334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 404/807] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:05:15 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/4f582800a7004e78a6fab0038b94cb8b/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:05:15.691334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4450d6-242e-418b-862e-46d581e03fc3 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.818994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4450d6-242e-418b-862e-46d581e03fc3 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:15.834325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12683ca7-cad1-4ca7-b591-b286d1bb943e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:15.868514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:15.869946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.870339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.870865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.871776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:15.872209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:15.873798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:15.875441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa35d8-947a-4d4b-8704-1ad32da98d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:15.876247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa35d8-947a-4d4b-8704-1ad32da98d7a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.876686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa35d8-947a-4d4b-8704-1ad32da98d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.877119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa35d8-947a-4d4b-8704-1ad32da98d7a None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.877946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa35d8-947a-4d4b-8704-1ad32da98d7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:15.878397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa35d8-947a-4d4b-8704-1ad32da98d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:15.879919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa35d8-947a-4d4b-8704-1ad32da98d7a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:15.890422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 404/809] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:05:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:15.891974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33433e-1506-493d-a518-2ced056957ee None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:15.892431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33433e-1506-493d-a518-2ced056957ee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:15.892729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:15.893001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33433e-1506-493d-a518-2ced056957ee None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:15.899874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 405/810] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:15.899874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.907862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 405/810] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:15.907862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33433e-1506-493d-a518-2ced056957ee None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:15.926461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:16.015048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d9b3b-9ce5-42aa-9825-98dc27a37fbe None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.030377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33433e-1506-493d-a518-2ced056957ee None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.054618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c7c10-0c73-4605-95e6-84e76c96b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.055250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7c10-0c73-4605-95e6-84e76c96b84d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.055527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7c10-0c73-4605-95e6-84e76c96b84d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.055799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7c10-0c73-4605-95e6-84e76c96b84d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.063883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7c10-0c73-4605-95e6-84e76c96b84d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.065491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7c10-0c73-4605-95e6-84e76c96b84d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.076430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.077252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.077695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-528c7c10-0c73-4605-95e6-84e76c96b84d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:16.077909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:16.079027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:16.080105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 406/811] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:05:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:16.080782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d2b3-2f33-4142-9be4-159a80293582 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.080782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d2b3-2f33-4142-9be4-159a80293582 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.080968 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d2b3-2f33-4142-9be4-159a80293582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.081304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.095644 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.097616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.100021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d809d2b3-2f33-4142-9be4-159a80293582 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:16.101466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d809d2b3-2f33-4142-9be4-159a80293582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:16.115926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:16.117605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:16.118510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:16.118510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:16.118510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:16.125347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 406/812] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:16.125347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:16.156505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:16.196173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 407/813] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:16.196173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809d2b3-2f33-4142-9be4-159a80293582 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:16.219093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:16.271367 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1930bd8-c6b3-424a-a346-0af66801055a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.316399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809d2b3-2f33-4142-9be4-159a80293582 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.322780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.323639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.324114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.325193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.326185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:16.327132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.329463 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.353520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.354186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.354479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.354744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.355373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:16.355716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.357226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.358012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 407/814] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:16.359352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:16.376725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 408/815] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:16.377320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:16.431460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:16.474634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0500469-fca4-4af7-b8bc-0545d5c12b52 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.499934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:16.511805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.512540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.512882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.513156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.513748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.515260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.516040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2299805-3f5e-410f-a57e-7462806b7bd4 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:16.525466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:16.526498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 11:05:16.527337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:16.531526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 408/816] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:16.532470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:16.561932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdae93-ddbc-4b66-8ec0-9fe6e167e2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.563029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdae93-ddbc-4b66-8ec0-9fe6e167e2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.563485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdae93-ddbc-4b66-8ec0-9fe6e167e2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.564210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdae93-ddbc-4b66-8ec0-9fe6e167e2b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.654140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdae93-ddbc-4b66-8ec0-9fe6e167e2b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.655516 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdae93-ddbc-4b66-8ec0-9fe6e167e2b4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.669411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b1c3-9cb8-4ac8-9d94-ba094547e9e9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.697194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:16.718298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.719263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.719786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.720276 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.735793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.737536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:16.749851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:16.750830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:16.751780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:16.758674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 409/817] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:16.759755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:16.761057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 409/818] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:16.761957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdae93-ddbc-4b66-8ec0-9fe6e167e2b4 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:16.814937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:16.872417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddc28b-ec00-4881-8f28-afa57a55e008 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.877691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdae93-ddbc-4b66-8ec0-9fe6e167e2b4 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:16.910724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.911284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.911566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.911838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.912522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] RBAC: Adding query filter params (name=network) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:16.912818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.914357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.916363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:16.917233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:16.917613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:16.917991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:16.918820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:16.919226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:16.920097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 410/819] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:16.921062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:16.925249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:16.938690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:16.958017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 410/820] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:16.958017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.050088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7f51-1b37-4863-8740-e93ef0016ced None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.064560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:17.072382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6da05b-ff8a-49c7-a20b-964ade6dcc60 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.086944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.087742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.088095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.088484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.099702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.101933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.110491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.111330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.111791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.112238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.113068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] RBAC: Adding query filter params (type=network) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:17.113548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.115098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:17.117199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:17.118232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:17.119125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:17.119125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:17.119125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:17.123101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 411/821] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:17.123940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.124392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 411/822] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:17.127264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.200452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:17.247656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf87ea-71a6-4d05-971a-e57cb609e571 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.261697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add27f54-c6aa-47ce-a2c7-f3f6c3c29703 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.298482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.299079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.299201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.299431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.299686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.300485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.300962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.301680 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.302922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:17.303437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.305593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.311963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.313422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.320641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 412/823] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:17.321704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:17.334171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:17.335125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:17.336016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:17.336016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:17.336016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:17.342507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 412/824] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:17.343713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.364886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:17.436750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ae3c-5839-4259-ba09-012eb9f24ef8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.454263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961666-db06-421e-a462-8b3b2b6d00cc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.460035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:17.476743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285ab99-cef4-4c91-9066-097eed7924c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.477810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285ab99-cef4-4c91-9066-097eed7924c8 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.477912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285ab99-cef4-4c91-9066-097eed7924c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.478120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285ab99-cef4-4c91-9066-097eed7924c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.478795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285ab99-cef4-4c91-9066-097eed7924c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.480173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285ab99-cef4-4c91-9066-097eed7924c8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.492738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.493941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.494420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.494887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.502118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.503553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:17.515143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:17.516185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:17.517223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 413/825] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:17.517727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.542485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 413/826] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:05:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:17.544235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c2de7-a891-4bf0-8ab6-2d873de26433 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.544602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c2de7-a891-4bf0-8ab6-2d873de26433 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.544883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c2de7-a891-4bf0-8ab6-2d873de26433 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.550864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 414/827] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:17.550864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c2de7-a891-4bf0-8ab6-2d873de26433 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.615515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:17.645846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4a0ff-be5a-4f32-b940-a2fc1511d5e4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.701250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d2b52-9899-4c28-bac3-96910284dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.702626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d2b52-9899-4c28-bac3-96910284dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.703087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d2b52-9899-4c28-bac3-96910284dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.703560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d2b52-9899-4c28-bac3-96910284dcc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.704494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c2de7-a891-4bf0-8ab6-2d873de26433 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.705098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d2b52-9899-4c28-bac3-96910284dcc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:17.705586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d2b52-9899-4c28-bac3-96910284dcc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.707426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d2b52-9899-4c28-bac3-96910284dcc5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.720760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 414/828] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:17.722283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5002-fe8b-4003-bfec-5552a01d5882 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.722795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5002-fe8b-4003-bfec-5552a01d5882 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.723175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5002-fe8b-4003-bfec-5552a01d5882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.743206 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b3ea5002-fe8b-4003-bfec-5552a01d5882 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:17.744679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b3ea5002-fe8b-4003-bfec-5552a01d5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:17.755958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.756625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.757465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.757841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.758659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:17.758966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.760439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.775071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 415/829] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:17.775994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.819703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:17.823562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 415/830] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:17.825670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5002-fe8b-4003-bfec-5552a01d5882 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.895594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:17.915356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5352168-c315-49b8-abc8-a123ba75e84a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.935028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5002-fe8b-4003-bfec-5552a01d5882 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:17.949280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.949912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.950193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.950466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.957098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.958497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.969029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeec5d2-6e92-4eae-a777-d05e38f76bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:17.969636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec5d2-6e92-4eae-a777-d05e38f76bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.969919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec5d2-6e92-4eae-a777-d05e38f76bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.970189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec5d2-6e92-4eae-a777-d05e38f76bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:17.970293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:17.971360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:17.972275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:17.972275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:17.972275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:17.972275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:17.972275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:17.972275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:17.972275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:17.972275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:17.972725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec5d2-6e92-4eae-a777-d05e38f76bf6 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=e64f4c342e714597b6c628ca022d7b9a) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:17.972725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec5d2-6e92-4eae-a777-d05e38f76bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:17.972868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 416/831] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:17.972868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:17.973002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec5d2-6e92-4eae-a777-d05e38f76bf6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:17.978860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 416/832] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/role_assignments?user.id=e64f4c342e714597b6c628ca022d7b9a&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:17.980231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214abc2c-520f-4819-8e35-6c50a08e2d40 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:17.980548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214abc2c-520f-4819-8e35-6c50a08e2d40 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:17.980819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214abc2c-520f-4819-8e35-6c50a08e2d40 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:17.981999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 417/833] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:17.982692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214abc2c-520f-4819-8e35-6c50a08e2d40 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:18.083132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:18.092816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd72669-3116-4d2a-a273-d33c6a5ae898 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:18.100388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214abc2c-520f-4819-8e35-6c50a08e2d40 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:18.127987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cc8c0-c57d-498b-98d9-9f98651a740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:18.128658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc8c0-c57d-498b-98d9-9f98651a740f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.128940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc8c0-c57d-498b-98d9-9f98651a740f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.129214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cc8c0-c57d-498b-98d9-9f98651a740f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.129813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cc8c0-c57d-498b-98d9-9f98651a740f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:18.129948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:18.131255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cc8c0-c57d-498b-98d9-9f98651a740f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:18.140068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-c88cc8c0-c57d-498b-98d9-9f98651a740f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:18.140977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:18.142131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:18.142961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 417/834] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:18.143769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245e02-fbc1-4a79-b768-5826f3bd9a24 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.143769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245e02-fbc1-4a79-b768-5826f3bd9a24 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.143889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c245e02-fbc1-4a79-b768-5826f3bd9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.144056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.144508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.144934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.145678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:18.145984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:18.148148 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:18.161633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 418/835] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:18.162517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:18.165197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-9c245e02-fbc1-4a79-b768-5826f3bd9a24 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:18.166586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9c245e02-fbc1-4a79-b768-5826f3bd9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:18.244430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 418/836] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:18.245069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c245e02-fbc1-4a79-b768-5826f3bd9a24 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:18.276691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6912d-282d-44f8-8d65-56781370aa9c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:18.315951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:18.316597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.316871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.317140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.317775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:18.318074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:18.319460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:18.328413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 419/837] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:18.328413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:18.348830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:18.364810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c245e02-fbc1-4a79-b768-5826f3bd9a24 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:18.380967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:18.401577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d637-e7d2-49eb-9e2d-db5b52f7d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:18.402237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d637-e7d2-49eb-9e2d-db5b52f7d04f None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.402518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d637-e7d2-49eb-9e2d-db5b52f7d04f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.402784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d637-e7d2-49eb-9e2d-db5b52f7d04f None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/b609ab814003472c9579134a5c91ab37/roles/e35eda3b7be4479380b1dbba47f6556f` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.418607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d637-e7d2-49eb-9e2d-db5b52f7d04f None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=b609ab814003472c9579134a5c91ab37, role_id=e35eda3b7be4479380b1dbba47f6556f)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:18.419985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d637-e7d2-49eb-9e2d-db5b52f7d04f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:18.434903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a0bb2-fd9e-435a-819b-8586ed336e22 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:18.467607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10a4b1-931c-4479-be8c-66fdaaa8103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:18.468237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a4b1-931c-4479-be8c-66fdaaa8103d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.468612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a4b1-931c-4479-be8c-66fdaaa8103d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.468880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10a4b1-931c-4479-be8c-66fdaaa8103d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.479153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10a4b1-931c-4479-be8c-66fdaaa8103d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7c10a4b1-931c-4479-be8c-66fdaaa8103d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:18.484248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:18.492019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 420/839] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:18.492930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10a4b1-931c-4479-be8c-66fdaaa8103d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:18.493706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 419/839] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:05:18 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/b609ab814003472c9579134a5c91ab37/roles/e35eda3b7be4479380b1dbba47f6556f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:05:18.496566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d637-e7d2-49eb-9e2d-db5b52f7d04f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:18.620246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10a4b1-931c-4479-be8c-66fdaaa8103d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:18.637254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:18.639171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d637-e7d2-49eb-9e2d-db5b52f7d04f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:18.671628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:18.672565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.673000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.673282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.673928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:18.674253 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:18.675581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:18.682039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 421/840] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:18.685260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:18.685948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.686231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.686500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.687182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:18.687484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:18.690854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:18.692948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:18.704857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 420/841] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:18.710812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:18.824997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1b41-b6ed-4acf-b5e7-abec7d3d9f4b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:18.863004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:18.863635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:18.863908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:18.864172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:18.874783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:18.876298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:18.891390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:18.892496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:18.893819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:18.893819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:18.893819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:18.893819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 422/842] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:18.898177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:19.009434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fc4f-c192-4a67-a7ff-82ffb02f1fc9 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:19.048563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:19.049173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:19.049450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:19.049721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:19.050365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:19.050665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:19.052129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:19.064756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 421/843] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:19.070069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:19.100146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:19.180033 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb34aa-f2bf-4b9b-af27-04747ac63e92 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:19.216549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:19.217186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:19.217467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:19.217740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:19.225059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:19.226650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:19.238482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:19.239472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:19.240437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 423/844] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:19.246393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:19.310815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:19.353930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a92d5-8ab3-44f0-bd02-04d6f109e1b7 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:19.387966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:19.388851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:19.389345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:19.389821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:19.390718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:19.391228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:19.392848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:19.411695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 422/845] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 10 11:05:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:19.418260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:19.504963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:19.521120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e2470-0a1d-45a3-9707-c2a30bab00b9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:19.558150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d119a2-e41b-400a-b44c-df9278b0ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:19.558965 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d119a2-e41b-400a-b44c-df9278b0ac63 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:19.559339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d119a2-e41b-400a-b44c-df9278b0ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:19.559708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d119a2-e41b-400a-b44c-df9278b0ac63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:19.630890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d119a2-e41b-400a-b44c-df9278b0ac63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:19.632716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d119a2-e41b-400a-b44c-df9278b0ac63 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:19.728692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:19.737397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 424/846] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:19.743468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:19.847537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91efbe-3876-46ad-8199-07e8aeb51d0c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:19.864669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:19.884047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:19.884646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:19.884928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:19.885206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:19.895329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:19.896795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:19.911605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:19.912802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:19.913855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:19.913855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:19.913855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:19.913855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 423/847] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:19.918608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d119a2-e41b-400a-b44c-df9278b0ac63 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:20.028271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d119a2-e41b-400a-b44c-df9278b0ac63 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:20.065381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62126ea-5060-46f7-b35b-f449363abb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:20.066149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62126ea-5060-46f7-b35b-f449363abb09 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.066535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62126ea-5060-46f7-b35b-f449363abb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.066910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62126ea-5060-46f7-b35b-f449363abb09 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.067660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62126ea-5060-46f7-b35b-f449363abb09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:20.068069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62126ea-5060-46f7-b35b-f449363abb09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:20.070275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62126ea-5060-46f7-b35b-f449363abb09 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:20.082508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 425/848] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:20.087730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:20.106098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27d19-cc9c-4ea4-8881-3bc78d828008 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.106378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27d19-cc9c-4ea4-8881-3bc78d828008 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.106652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27d19-cc9c-4ea4-8881-3bc78d828008 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.108336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 426/849] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:20.113124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba48f26-c7d7-426c-9268-a4e899400565 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.113409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba48f26-c7d7-426c-9268-a4e899400565 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.113682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba48f26-c7d7-426c-9268-a4e899400565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.133176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-dba48f26-c7d7-426c-9268-a4e899400565 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:20.134501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dba48f26-c7d7-426c-9268-a4e899400565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:20.179040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:20.209326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5abf0d-e96a-4b99-9a8f-034fec1e9edd None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:20.212585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 427/850] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:20.234627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba48f26-c7d7-426c-9268-a4e899400565 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:20.247522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:20.248532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.248956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.249408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.256871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:20.258634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:20.271058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:20.272196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:20.273156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:20.273156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:20.273156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:20.273156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:20.273156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:20.273156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:20.273156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:20.273156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:20.275173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 424/851] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:20.281227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:20.312327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:20.352893 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba48f26-c7d7-426c-9268-a4e899400565 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:20.396534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0970-66e2-4925-961e-4601c054e48b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:20.401443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:20.402126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.402411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.402670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.403260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:20.404705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:20.418334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:20.419359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:20.420349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:20.424824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 428/852] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 10 11:05:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:20.425770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:20.445358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:20.446470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.446951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.447464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.448591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:20.449147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:20.450910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:20.470111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 425/853] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:20.471343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:20.474787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:20.549897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b66a84-a950-4e3a-a488-d50e39c8e3c3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:20.588271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:20.588914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.589194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.589467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.590192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:20.590386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:20.591948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:20.594329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:20.602137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 429/854] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:20.604217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:20.613034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af20f2-8333-48fa-91e7-6cb26acba579 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:20.653820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552fab-a695-42c6-9631-6732adf0cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:20.654867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552fab-a695-42c6-9631-6732adf0cbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.655249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552fab-a695-42c6-9631-6732adf0cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.655620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552fab-a695-42c6-9631-6732adf0cbd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.657273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552fab-a695-42c6-9631-6732adf0cbd4 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=4f582800a7004e78a6fab0038b94cb8b) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:20.657685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552fab-a695-42c6-9631-6732adf0cbd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:20.659731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552fab-a695-42c6-9631-6732adf0cbd4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:20.676911 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 426/855] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:20 2022] GET /identity/v3/role_assignments?user.id=4f582800a7004e78a6fab0038b94cb8b&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:20.678687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581937-da5d-40f0-9565-bccdce4b9a20 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.679156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581937-da5d-40f0-9565-bccdce4b9a20 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.679442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581937-da5d-40f0-9565-bccdce4b9a20 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.692380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 427/856] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:20.692380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b7fa-df07-4517-ab3d-f8f1d08ef236 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.692380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b7fa-df07-4517-ab3d-f8f1d08ef236 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.692380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b7fa-df07-4517-ab3d-f8f1d08ef236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.718350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2e68b7fa-df07-4517-ab3d-f8f1d08ef236 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:20.719604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2e68b7fa-df07-4517-ab3d-f8f1d08ef236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:20.720122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f9df7-3fcf-449d-b778-651f14804b37 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:20.723628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:20.761130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:20.761874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.762221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.762555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.763275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:20.763640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:20.765152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:20.776917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 430/857] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:20.813174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 428/858] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:20.838270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:20.938577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80160b37-8a5c-44cf-9558-769c97f60b0e None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.938876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80160b37-8a5c-44cf-9558-769c97f60b0e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.939048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80160b37-8a5c-44cf-9558-769c97f60b0e None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.940552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 429/859] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:20.946700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956d436-ff50-4d7f-ab06-42c491be9b00 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:20.946971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956d436-ff50-4d7f-ab06-42c491be9b00 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:20.947252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956d436-ff50-4d7f-ab06-42c491be9b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:20.954089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03bd9-25fe-489b-a887-f9ca062ca7ac None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:20.971629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-0956d436-ff50-4d7f-ab06-42c491be9b00 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:20.972865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0956d436-ff50-4d7f-ab06-42c491be9b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:21.004091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf12b37-e7cf-41d5-8669-8a18f5697423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:21.004914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12b37-e7cf-41d5-8669-8a18f5697423 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:21.005392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12b37-e7cf-41d5-8669-8a18f5697423 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:21.005677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12b37-e7cf-41d5-8669-8a18f5697423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:21.017897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf12b37-e7cf-41d5-8669-8a18f5697423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-abf12b37-e7cf-41d5-8669-8a18f5697423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:21.023317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:21.024254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:21.025153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 431/860] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:05:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:21.033845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf12b37-e7cf-41d5-8669-8a18f5697423 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:21.070215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:21.072149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 430/861] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:21.095564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956d436-ff50-4d7f-ab06-42c491be9b00 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:21.114076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:21.155139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf12b37-e7cf-41d5-8669-8a18f5697423 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:21.200331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:21.200881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:21.201157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:21.201427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:21.202093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:21.202424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:21.204644 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:21.215516 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956d436-ff50-4d7f-ab06-42c491be9b00 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:21.220514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 432/862] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:05:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:21.221319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:21.259083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de995f8-7220-4b82-bc0a-a604e50f9f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:21.259705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de995f8-7220-4b82-bc0a-a604e50f9f91 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:21.259978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de995f8-7220-4b82-bc0a-a604e50f9f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:21.260570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de995f8-7220-4b82-bc0a-a604e50f9f91 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:21.261251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de995f8-7220-4b82-bc0a-a604e50f9f91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:21.262910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de995f8-7220-4b82-bc0a-a604e50f9f91 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:21.324606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:21.334413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6c7fc-1242-4911-880a-bf75bd84e106 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:21.360534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 431/863] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:05:21 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:21.391437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:21.392645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:21.393134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:21.393626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:21.406841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:21.408813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:21.426752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:21.436224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:21.437252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:21.437252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:21.437252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:21.437252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 433/864] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:21.443226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de995f8-7220-4b82-bc0a-a604e50f9f91 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:21.525477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:21.564836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de995f8-7220-4b82-bc0a-a604e50f9f91 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:21.601441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:21.602060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:21.602335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:21.602602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:21.603243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:21.603539 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:21.604928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:21.617827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 432/865] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:21.623117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:21.725111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0e0f-d516-4e06-ada9-9d6a7759214b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:21.763648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:21.764446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:21.764819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:21.765183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:21.774577 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:21.776185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:21.778100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:21.788619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:21.789730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:21.790904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:21.792653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 434/866] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:05:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:21.797990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:21.912171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf0b39-2e03-4222-b6db-e43ddc5cc4e1 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:21.945531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:21.950998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:21.951612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:21.951887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:21.952159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:21.952949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:21.953248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:21.954674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:21.973696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 433/867] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 11:05:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:21.981440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:22.105189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff5976-240b-47aa-b06e-cf016e5ccdc6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:22.142988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce99e5-ef97-49d3-af7f-33fbf1217e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:22.143601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce99e5-ef97-49d3-af7f-33fbf1217e42 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:22.143882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce99e5-ef97-49d3-af7f-33fbf1217e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:22.144154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce99e5-ef97-49d3-af7f-33fbf1217e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:22.211054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:22.214727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce99e5-ef97-49d3-af7f-33fbf1217e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:22.216177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce99e5-ef97-49d3-af7f-33fbf1217e42 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:22.316441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 435/868] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:21 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:22.322368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:22.434691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5d97f-68bf-4030-8087-6d36d7debf54 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:22.470322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:22.470951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:22.471224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:22.471492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:22.481817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:22.485964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:22.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:22.499188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:22.500087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:22.500087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:22.500087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:22.500087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 434/869] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:22.507423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce99e5-ef97-49d3-af7f-33fbf1217e42 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:22.622018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:22.625656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce99e5-ef97-49d3-af7f-33fbf1217e42 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:22.661123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:22.662249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:22.663408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:22.663685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:22.664488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:22.664795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:22.666178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:22.687002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 436/870] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:22.692692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:22.738608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:22.803140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e93f28-855b-48cd-aa90-031c7b757084 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:22.838214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6143a-4fb2-43c6-8902-c7ef4904bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:22.838845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6143a-4fb2-43c6-8902-c7ef4904bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:22.839379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6143a-4fb2-43c6-8902-c7ef4904bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:22.839707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6143a-4fb2-43c6-8902-c7ef4904bcd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:22.846427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6143a-4fb2-43c6-8902-c7ef4904bcd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:22.847858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6143a-4fb2-43c6-8902-c7ef4904bcd5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-10a6143a-4fb2-43c6-8902-c7ef4904bcd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:22.859508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:22.860442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:22.861361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 435/871] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:22.868531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:22.878879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60b51-0eae-4820-be26-058e2e67e9b8 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:22.879164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60b51-0eae-4820-be26-058e2e67e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:22.879435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60b51-0eae-4820-be26-058e2e67e9b8 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:22.881054 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 436/872] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:22.885920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619d922-9fb2-413c-98a1-b879743afb67 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:22.886204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619d922-9fb2-413c-98a1-b879743afb67 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:22.886476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619d922-9fb2-413c-98a1-b879743afb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:22.905302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c619d922-9fb2-413c-98a1-b879743afb67 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:22.906737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c619d922-9fb2-413c-98a1-b879743afb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:22.980542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 437/873] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:22.999830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded19249-5e9e-4b6e-ac02-9881409d03bd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:23.001993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619d922-9fb2-413c-98a1-b879743afb67 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:23.035707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:23.047055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb218d-2151-4a56-962b-68a522e86189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:23.047668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb218d-2151-4a56-962b-68a522e86189 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.048259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb218d-2151-4a56-962b-68a522e86189 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.048385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb218d-2151-4a56-962b-68a522e86189 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.049025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb218d-2151-4a56-962b-68a522e86189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:23.049563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb218d-2151-4a56-962b-68a522e86189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:23.050736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb218d-2151-4a56-962b-68a522e86189 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:23.063838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 437/874] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:23.065396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418675c4-4256-435e-8d14-71d60cdd62ab None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.065923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418675c4-4256-435e-8d14-71d60cdd62ab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.066484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418675c4-4256-435e-8d14-71d60cdd62ab None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.067878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 438/875] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:23.069694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418675c4-4256-435e-8d14-71d60cdd62ab None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:23.090381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:23.116610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619d922-9fb2-413c-98a1-b879743afb67 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:23.153408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8aec9-cfc9-4a36-9d58-39ffdd6669cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:23.154196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8aec9-cfc9-4a36-9d58-39ffdd6669cc None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.154561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8aec9-cfc9-4a36-9d58-39ffdd6669cc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.154950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8aec9-cfc9-4a36-9d58-39ffdd6669cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.155889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8aec9-cfc9-4a36-9d58-39ffdd6669cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:23.157344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8aec9-cfc9-4a36-9d58-39ffdd6669cc None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-11e8aec9-cfc9-4a36-9d58-39ffdd6669cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:23.167710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:23.168767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:23.169631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 438/876] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:23.170451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b27d9-3b35-4d3c-92c4-bf09013033fd None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.170451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b27d9-3b35-4d3c-92c4-bf09013033fd None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.170451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b27d9-3b35-4d3c-92c4-bf09013033fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.184122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418675c4-4256-435e-8d14-71d60cdd62ab None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:23.189855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-622b27d9-3b35-4d3c-92c4-bf09013033fd None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:23.191187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-622b27d9-3b35-4d3c-92c4-bf09013033fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:23.220802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:23.221494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.221845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.222195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.222913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=b609ab814003472c9579134a5c91ab37) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:23.223220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:23.224671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:23.230698 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 439/877] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:23 2022] GET /identity/v3/role_assignments?user.id=b609ab814003472c9579134a5c91ab37&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:23.233247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:23.281937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 439/878] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:23.303687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b27d9-3b35-4d3c-92c4-bf09013033fd None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:23.333508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:23.362988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:23.388734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00756e-61d7-4e0d-aea9-faeba139c9ff None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:23.418575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b27d9-3b35-4d3c-92c4-bf09013033fd None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:23.431217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:23.431843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.432129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.432442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.433904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:23.434205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:23.435558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:23.440369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 440/879] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:23.447746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:23.459646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d3b61-1891-46b0-86cc-776df509875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:23.460851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d3b61-1891-46b0-86cc-776df509875c None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.461146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d3b61-1891-46b0-86cc-776df509875c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.461967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d3b61-1891-46b0-86cc-776df509875c None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.462357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d3b61-1891-46b0-86cc-776df509875c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:23.464854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d3b61-1891-46b0-86cc-776df509875c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:23.558358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711abf2-5012-4d45-b6af-b642df398729 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:23.570527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 440/880] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:05:23 2022] POST /identity/v3/services => generated 269 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:05:23.572337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7b3fa-6615-4ac7-bc3a-a44854268357 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.572624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7b3fa-6615-4ac7-bc3a-a44854268357 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.579099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7b3fa-6615-4ac7-bc3a-a44854268357 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.579099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 441/881] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:23.579717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888891-cb30-4047-afe3-be86255a0421 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.580004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888891-cb30-4047-afe3-be86255a0421 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.580275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888891-cb30-4047-afe3-be86255a0421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.600745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-02888891-cb30-4047-afe3-be86255a0421 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:23.602237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-02888891-cb30-4047-afe3-be86255a0421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:23.613890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:23.614944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.615270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.615563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.616240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:23.616659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:23.618127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:23.624408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 441/882] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:23.691822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 442/883] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:23.716572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:23.727068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:23.833472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3537ee-6cec-49f1-994e-cb9fdf5594a2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:23.868497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:23.869505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:23.870414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:23.870892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:23.871675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:23.873318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:23.885499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:23.886544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:23.887389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:23.890211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 442/884] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:23.900372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02888891-cb30-4047-afe3-be86255a0421 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:23.916756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:24.001228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02888891-cb30-4047-afe3-be86255a0421 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:24.037745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:24.038375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.038654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.038927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.039558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:24.039857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:24.041265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:24.046367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 443/885] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:24.051883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:24.127885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:24.161961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a01d-b2d7-4d19-9397-770a3cdc9680 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:24.199840 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:24.200493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.200768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.201105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.201742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:24.202042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:24.203392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:24.208502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 443/886] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:24.214448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:24.296949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:24.316460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07333-d9df-4c9c-b03c-bb5dc8d4e8ec None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:24.351608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a3775-6a19-4599-b43d-1fba896591cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:24.352222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a3775-6a19-4599-b43d-1fba896591cc None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.352527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a3775-6a19-4599-b43d-1fba896591cc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.352795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a3775-6a19-4599-b43d-1fba896591cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.353501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a3775-6a19-4599-b43d-1fba896591cc None admin] RBAC: Adding query filter params (interface=public, service_id=d7da8a63126942fb86f4497a4362ca41, region_id=RegionOne) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:24.353806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a3775-6a19-4599-b43d-1fba896591cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:24.355177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a3775-6a19-4599-b43d-1fba896591cc None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:24.360954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 444/887] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 11:05:24 2022] GET /identity/v3/endpoints?service_id=d7da8a63126942fb86f4497a4362ca41&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:24.366943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:24.469911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f54af-21a8-4a6b-9200-f71b721adb99 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:24.504928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbadc4-e80d-4a6c-9446-e124d02a3f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:24.505543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbadc4-e80d-4a6c-9446-e124d02a3f8a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:24.505824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbadc4-e80d-4a6c-9446-e124d02a3f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:24.506126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbadc4-e80d-4a6c-9446-e124d02a3f8a None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:24.506879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbadc4-e80d-4a6c-9446-e124d02a3f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:24.508824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbadc4-e80d-4a6c-9446-e124d02a3f8a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:24.514885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 444/888] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:05:24 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:05:24.515446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:25.447441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e76e-a886-4695-b514-6425183da58b None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:25.448008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e76e-a886-4695-b514-6425183da58b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:25.448277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e76e-a886-4695-b514-6425183da58b None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:25.449992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 445/889] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:25.455398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5fcdd-bb1e-44eb-9bc0-6a6dc945e769 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:25.455835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5fcdd-bb1e-44eb-9bc0-6a6dc945e769 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:25.456129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5fcdd-bb1e-44eb-9bc0-6a6dc945e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:25.475280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e3b5fcdd-bb1e-44eb-9bc0-6a6dc945e769 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:25.476471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e3b5fcdd-bb1e-44eb-9bc0-6a6dc945e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:25.548705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 445/890] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:25.571421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253e76e-a886-4695-b514-6425183da58b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:25.679185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253e76e-a886-4695-b514-6425183da58b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:25.684214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647503-0cc0-415d-888e-8b8dba4127d8 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:25.684525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647503-0cc0-415d-888e-8b8dba4127d8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:25.684796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81647503-0cc0-415d-888e-8b8dba4127d8 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:25.686366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 446/891] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:25.691142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b7049-b359-490a-aa78-a4bc83ce6cd5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:25.691422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b7049-b359-490a-aa78-a4bc83ce6cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:25.691696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b7049-b359-490a-aa78-a4bc83ce6cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:25.709757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-625b7049-b359-490a-aa78-a4bc83ce6cd5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:25.710696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-625b7049-b359-490a-aa78-a4bc83ce6cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:25.718333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e1783-4054-4288-9463-8e87369583ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:25.719112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e1783-4054-4288-9463-8e87369583ff None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:25.719393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e1783-4054-4288-9463-8e87369583ff None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:25.719648 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e1783-4054-4288-9463-8e87369583ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:25.732300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e1783-4054-4288-9463-8e87369583ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-656e1783-4054-4288-9463-8e87369583ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:25.738523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:25.739498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:25.740448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:25.744385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 446/892] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 11:05:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:25.746917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e1783-4054-4288-9463-8e87369583ff None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:25.752909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:25.791822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 447/893] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:25.793132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2780e20-83ed-4730-aa1d-4bba7ce43bee None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:25.793417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2780e20-83ed-4730-aa1d-4bba7ce43bee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:25.793690 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2780e20-83ed-4730-aa1d-4bba7ce43bee None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:25.796464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 448/894] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:25.799948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82b37-239f-4386-99d0-043c1c9d14f1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:25.800479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82b37-239f-4386-99d0-043c1c9d14f1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:25.800961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82b37-239f-4386-99d0-043c1c9d14f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:25.829891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f3b82b37-239f-4386-99d0-043c1c9d14f1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:25.831054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f3b82b37-239f-4386-99d0-043c1c9d14f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:25.859000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e1783-4054-4288-9463-8e87369583ff None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:25.887006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:25.893441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:25.894050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:25.894338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:25.894605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:25.895267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:25.895564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:25.896989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:25.902487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 449/895] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:25.903462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b82b37-239f-4386-99d0-043c1c9d14f1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:25.910658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 447/896] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 11:05:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:25.925685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:25.994164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:26.018223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b82b37-239f-4386-99d0-043c1c9d14f1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.031340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d48a7-1f72-461b-9108-3df2ad96c2ca None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.053689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.054393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.054674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.054930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.055512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.056903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:26.065791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:26.066737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:26.067629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 450/897] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 10 11:05:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:26.069666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.074048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.074695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.074976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.075249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.086551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.087997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:26.102208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:26.103207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:26.104110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:26.104110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:26.104110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:26.104110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 448/898] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:26.104110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.136685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:26.187403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75856-aafd-4ccb-b465-8e8e2ae6827c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.215486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a27cc-4f31-4cda-9ace-5d3243bd725d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.223785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb8e6d-0c7a-4103-aa7a-77002227f8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.224424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8e6d-0c7a-4103-aa7a-77002227f8c0 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.224747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8e6d-0c7a-4103-aa7a-77002227f8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.225021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8e6d-0c7a-4103-aa7a-77002227f8c0 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.225751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb8e6d-0c7a-4103-aa7a-77002227f8c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.227107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb8e6d-0c7a-4103-aa7a-77002227f8c0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.233209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:26.250388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.250940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.251192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.251462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.252093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:26.252454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.253831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.259233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 449/899] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:26.259841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.308342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 451/900] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:05:26 2022] POST /identity/v3/services => generated 241 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:26.308342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb8e6d-0c7a-4103-aa7a-77002227f8c0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.371636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4d18-1c4d-4cd6-aaa9-39e3fff33846 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.417503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.418183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.418468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.418785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.419587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:26.419885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.421444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.434676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 450/901] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:26.440925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.451437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb8e6d-0c7a-4103-aa7a-77002227f8c0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.467243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:26.495570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:26.499866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.500882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.501300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.501733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.503296 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:26.503781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.505412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.513253 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 452/902] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:26.520035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.587941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55057d-0431-4006-89fd-757d8f19ff51 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.623875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf82cc8-6d89-4288-bdc2-4a18cbd03164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.624538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82cc8-6d89-4288-bdc2-4a18cbd03164 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.624821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82cc8-6d89-4288-bdc2-4a18cbd03164 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.625093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf82cc8-6d89-4288-bdc2-4a18cbd03164 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.632574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf82cc8-6d89-4288-bdc2-4a18cbd03164 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.634018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf82cc8-6d89-4288-bdc2-4a18cbd03164 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-dcf82cc8-6d89-4288-bdc2-4a18cbd03164 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:26.646192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:26.647848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:26.648829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:26.649364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253981-2b86-4928-83b3-9d14480f6845 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.652883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 451/903] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:26.654045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f994-6cb9-4a74-be92-4e06ca525631 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.654334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f994-6cb9-4a74-be92-4e06ca525631 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.654602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f994-6cb9-4a74-be92-4e06ca525631 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.656271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 452/904] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:26.656797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f994-6cb9-4a74-be92-4e06ca525631 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.690759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b992fd-718c-46d1-943b-0badb22e236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.691377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b992fd-718c-46d1-943b-0badb22e236a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.691680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b992fd-718c-46d1-943b-0badb22e236a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.691916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b992fd-718c-46d1-943b-0badb22e236a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.692643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b992fd-718c-46d1-943b-0badb22e236a None admin] RBAC: Adding query filter params (interface=public, service_id=b12a275ac9804ebfbd630391c95c5c06, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:26.692947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b992fd-718c-46d1-943b-0badb22e236a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.694375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b992fd-718c-46d1-943b-0badb22e236a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.699381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 453/905] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/endpoints?service_id=b12a275ac9804ebfbd630391c95c5c06&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:26.700634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c17c-0ed7-4cf6-b33e-b067fd26c176 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.700915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c17c-0ed7-4cf6-b33e-b067fd26c176 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.701185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c17c-0ed7-4cf6-b33e-b067fd26c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.721025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6e71c17c-0ed7-4cf6-b33e-b067fd26c176 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:26.722194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6e71c17c-0ed7-4cf6-b33e-b067fd26c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:26.759142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:26.769596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:26.775143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f994-6cb9-4a74-be92-4e06ca525631 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.793747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 454/906] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:26.794602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71c17c-0ed7-4cf6-b33e-b067fd26c176 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.827337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.827963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.828244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.828553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.829297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:26.829604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.831044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.849538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 453/907] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:26.851117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.910657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71c17c-0ed7-4cf6-b33e-b067fd26c176 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:26.949332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3162ef-639f-4ef7-a2e8-76e154771d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:26.949947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3162ef-639f-4ef7-a2e8-76e154771d49 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:26.950227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3162ef-639f-4ef7-a2e8-76e154771d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:26.950500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3162ef-639f-4ef7-a2e8-76e154771d49 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:26.951109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3162ef-639f-4ef7-a2e8-76e154771d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:26.952494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3162ef-639f-4ef7-a2e8-76e154771d49 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:26.958564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 455/908] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:05:26.959882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3162ef-639f-4ef7-a2e8-76e154771d49 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:26.960645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a28803-b43d-4340-9a50-a078686d9433 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.004222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:27.008804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.013347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.013347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.013347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.013347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.013347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:27.023457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:27.024805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 11:05:27.025894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:27.028534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 454/909] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:27.044338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:27.062711 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:27.088747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3162ef-639f-4ef7-a2e8-76e154771d49 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.129748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27865c1b-c550-4111-aa4c-5c9303fc1436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.130563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865c1b-c550-4111-aa4c-5c9303fc1436 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.130835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865c1b-c550-4111-aa4c-5c9303fc1436 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.131647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865c1b-c550-4111-aa4c-5c9303fc1436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.153267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da569bb6-e282-4bb1-8c35-2e4041738cd6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.196861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.197472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.197752 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.198023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.198649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:27.198950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.200360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.209679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 455/910] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:27.211253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:27.211366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27865c1b-c550-4111-aa4c-5c9303fc1436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.212857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27865c1b-c550-4111-aa4c-5c9303fc1436 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.258551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:27.308052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:27.325550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954a2f-a46d-4e60-9c42-5ef742bc0bbd None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.337627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 456/911] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:26 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:27.342843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27865c1b-c550-4111-aa4c-5c9303fc1436 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:27.364762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.366356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.366960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.367434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.368256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:27.368793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.370451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.377410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 456/912] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 10 11:05:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:27.383470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:27.453735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27865c1b-c550-4111-aa4c-5c9303fc1436 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.491468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.492117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.492343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.492626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.494973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:27.498417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ec33-df94-4b85-bfc7-e13c634ada53 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.505275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.506881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:27.523179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:27.524185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:27.525676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:27.525676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:27.525676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:27.528759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 457/913] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:27.530325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:27.543296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72486da-b42e-4b78-8538-1dcd0f4a96a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.544358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72486da-b42e-4b78-8538-1dcd0f4a96a8 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.544890 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72486da-b42e-4b78-8538-1dcd0f4a96a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.545357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72486da-b42e-4b78-8538-1dcd0f4a96a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.546244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72486da-b42e-4b78-8538-1dcd0f4a96a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.548015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72486da-b42e-4b78-8538-1dcd0f4a96a8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.634174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 457/914] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:05:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:05:27.642283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3efd7-5b1b-4179-8305-bebe11d3aa0c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.689898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.690524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.690805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.691078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.691787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:27.692144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.694223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.708506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 458/915] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:27.715174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72486da-b42e-4b78-8538-1dcd0f4a96a8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:27.719399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:27.834874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72486da-b42e-4b78-8538-1dcd0f4a96a8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:27.871080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:27.871722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:27.872001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:27.872271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:27.879087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:27.880545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:27.892625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:27.893549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:27.895043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 458/916] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:27.900273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:27.947907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:28.007460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482781ed-a67b-48c8-b2fb-f97a2dc25c1d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:28.043380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2eb7-6f56-43d4-b69a-838ff9de2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:28.044282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2eb7-6f56-43d4-b69a-838ff9de2696 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:28.044729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2eb7-6f56-43d4-b69a-838ff9de2696 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:28.045139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2eb7-6f56-43d4-b69a-838ff9de2696 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:28.045974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2eb7-6f56-43d4-b69a-838ff9de2696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:28.046436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2eb7-6f56-43d4-b69a-838ff9de2696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:28.047979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2eb7-6f56-43d4-b69a-838ff9de2696 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:28.061418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 459/917] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:28.067848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:28.135033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:28.176072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67214123-f419-4816-b7f7-36cf1f690bda None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:28.211986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4c42-f6bb-4b0f-843e-09031e96f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:28.212671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4c42-f6bb-4b0f-843e-09031e96f697 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:28.212952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4c42-f6bb-4b0f-843e-09031e96f697 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:28.213223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4c42-f6bb-4b0f-843e-09031e96f697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:28.213943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4c42-f6bb-4b0f-843e-09031e96f697 None admin] RBAC: Adding query filter params (role.id=cc7f11a1b669499daed397d417c3111b, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=b609ab814003472c9579134a5c91ab37) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:28.214246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4c42-f6bb-4b0f-843e-09031e96f697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:28.215668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4c42-f6bb-4b0f-843e-09031e96f697 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:28.221828 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 459/918] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:28 2022] GET /identity/v3/role_assignments?user.id=b609ab814003472c9579134a5c91ab37&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=cc7f11a1b669499daed397d417c3111b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:28.410268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f64a-b470-4599-8b16-58431881fd17 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:28.410628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f64a-b470-4599-8b16-58431881fd17 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:28.410831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f64a-b470-4599-8b16-58431881fd17 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:28.412338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 460/919] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:28.417862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601ad96-4c83-4332-9af0-d23030735731 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:28.418155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601ad96-4c83-4332-9af0-d23030735731 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:28.418426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601ad96-4c83-4332-9af0-d23030735731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:28.438360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-0601ad96-4c83-4332-9af0-d23030735731 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:28.438360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0601ad96-4c83-4332-9af0-d23030735731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:28.507725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 460/920] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:28.530964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18f64a-b470-4599-8b16-58431881fd17 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:28.637336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18f64a-b470-4599-8b16-58431881fd17 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:28.641497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:28.674429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:28.675115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:28.675395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:28.675664 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:28.676250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:28.678406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:28.687522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:28.688612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:28.689465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 461/921] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:28.697913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601ad96-4c83-4332-9af0-d23030735731 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:28.756702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:28.799577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601ad96-4c83-4332-9af0-d23030735731 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:28.845730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:28.846339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:28.846612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:28.846883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:28.847520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:28.847816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:28.849207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:28.855013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 461/922] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:28.860784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:28.970254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6af12e-10f8-4ae7-bb26-11cbe0ddb064 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:29.005697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484edb50-2ee7-4705-afa7-62a88dc49b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:29.006449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edb50-2ee7-4705-afa7-62a88dc49b23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.006728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edb50-2ee7-4705-afa7-62a88dc49b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.007001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484edb50-2ee7-4705-afa7-62a88dc49b23 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.007686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484edb50-2ee7-4705-afa7-62a88dc49b23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:29.008026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484edb50-2ee7-4705-afa7-62a88dc49b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:29.009426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484edb50-2ee7-4705-afa7-62a88dc49b23 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:29.014749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 462/923] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:29.020540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:29.091567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36812-0a0b-4c33-a2d0-205c16e69fc0 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.091881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36812-0a0b-4c33-a2d0-205c16e69fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.092101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae36812-0a0b-4c33-a2d0-205c16e69fc0 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.093731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 463/924] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:29.098708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0697c-2279-4fb5-aadd-958b85f8516f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.099211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0697c-2279-4fb5-aadd-958b85f8516f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.099984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0697c-2279-4fb5-aadd-958b85f8516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.119141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-57f0697c-2279-4fb5-aadd-958b85f8516f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:29.120802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-57f0697c-2279-4fb5-aadd-958b85f8516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:29.129743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e42e1-6433-4d50-8e46-ce802dbb669f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:29.147827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:29.153111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:29.167422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:29.180385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.180385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.180385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.180385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] RBAC: Adding query filter params (interface=public, service_id=5c0eeb10651644d18f0de14ce6d51586, region_id=RegionOne) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:29.180385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:29.180385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:29.180832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 462/925] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 11:05:29 2022] GET /identity/v3/endpoints?service_id=5c0eeb10651644d18f0de14ce6d51586&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:29.182839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:29.205793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 464/926] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:29.229863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0697c-2279-4fb5-aadd-958b85f8516f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:29.320403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7a8b5-1232-41db-b0d2-ef2887fe740e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:29.342221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0697c-2279-4fb5-aadd-958b85f8516f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:29.360094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae35ee-0361-40c5-ac2c-0814cb7c0eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:29.360850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae35ee-0361-40c5-ac2c-0814cb7c0eef None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.361207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae35ee-0361-40c5-ac2c-0814cb7c0eef None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.361489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae35ee-0361-40c5-ac2c-0814cb7c0eef None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.362202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae35ee-0361-40c5-ac2c-0814cb7c0eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:29.363797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae35ee-0361-40c5-ac2c-0814cb7c0eef None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:29.372346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 463/927] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:05:29 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:05:29.392091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:29.393115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.393532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.393938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.394665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:29.396264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:29.407066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:29.408294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 11:05:29.409435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:29.411887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 465/928] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 10 11:05:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:29.418987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae35ee-0361-40c5-ac2c-0814cb7c0eef None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:29.476587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:29.533959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae35ee-0361-40c5-ac2c-0814cb7c0eef None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:29.571392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:29.572011 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.572292 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.572620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.573271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:29.573534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:29.574955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:29.580183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 464/929] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:29.586330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:29.616366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:29.695815 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f459-4d6f-43e4-be9e-0d9a0ce9d425 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:29.732393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf22f60-c649-49b3-bf3e-aaaa478dec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:29.733015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf22f60-c649-49b3-bf3e-aaaa478dec51 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.733297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf22f60-c649-49b3-bf3e-aaaa478dec51 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.733573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf22f60-c649-49b3-bf3e-aaaa478dec51 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.734273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf22f60-c649-49b3-bf3e-aaaa478dec51 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:29.734640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf22f60-c649-49b3-bf3e-aaaa478dec51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:29.736109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf22f60-c649-49b3-bf3e-aaaa478dec51 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:29.741675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 466/930] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:29.747274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:29.855226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246696-599a-488a-b1d9-0d4cc996618b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:29.871084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:29.891119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef74c68-3d4d-43f2-899d-ad3a541251e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:29.891733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef74c68-3d4d-43f2-899d-ad3a541251e0 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.894182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef74c68-3d4d-43f2-899d-ad3a541251e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.894182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef74c68-3d4d-43f2-899d-ad3a541251e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.894182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef74c68-3d4d-43f2-899d-ad3a541251e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:29.894422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef74c68-3d4d-43f2-899d-ad3a541251e0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:29.940036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b961ba-09a1-4458-9a6e-5c958a448e8f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.940375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b961ba-09a1-4458-9a6e-5c958a448e8f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.940799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b961ba-09a1-4458-9a6e-5c958a448e8f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.942328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 467/931] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:29.948290 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576d33c-03d7-44fe-bd41-f77c0199cc0d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:29.948607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576d33c-03d7-44fe-bd41-f77c0199cc0d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:29.948884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576d33c-03d7-44fe-bd41-f77c0199cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:29.967833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0576d33c-03d7-44fe-bd41-f77c0199cc0d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:29.969082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0576d33c-03d7-44fe-bd41-f77c0199cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:30.001814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 465/932] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:05:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:30.059136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 468/933] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:30.085376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef74c68-3d4d-43f2-899d-ad3a541251e0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:30.200236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef74c68-3d4d-43f2-899d-ad3a541251e0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:30.236910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:30.237533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:30.237810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:30.238087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:30.238669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa55d-8838-4a82-bb8f-e1a14b3eb403 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:30.238779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:30.238955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa55d-8838-4a82-bb8f-e1a14b3eb403 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:30.239237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa55d-8838-4a82-bb8f-e1a14b3eb403 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:30.240764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:30.241689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 469/934] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:30.243583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING keystone.server.flask.common [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 11:05:30.247848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083cba-5058-4dd8-b04a-d83254f39179 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:30.248368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083cba-5058-4dd8-b04a-d83254f39179 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:30.249299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083cba-5058-4dd8-b04a-d83254f39179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:30.270388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6b083cba-5058-4dd8-b04a-d83254f39179 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:30.271614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6b083cba-5058-4dd8-b04a-d83254f39179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:30.282558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:30.293754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.sql.core [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 11:05:30.293754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 11:05:30.293754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [parameters: {'id': '8372d67081fc48c8874f73a3d4a76d47', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 11:05:30.293754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8372d67081fc48c8874f73a3d4a76d47.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8372d67081fc48c8874f73a3d4a76d47. Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application conn.query(q) Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 11:05:30.300730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result.read() Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 11:05:30.301558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application next(self.gen) Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application yield resource Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application next(self.gen) Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise self.value Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application session.commit() Aug 10 11:05:30.302592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.session.flush() Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application compat.raise_( Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 11:05:30.304111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 11:05:30.306532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application conn.query(q) Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result.read() Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 11:05:30.307847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [parameters: {'id': '8372d67081fc48c8874f73a3d4a76d47', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:30.312276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:30.314299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8372d67081fc48c8874f73a3d4a76d47. Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 466/935] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Aug 10 11:05:30 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:30.316662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:30.348552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:30.352447 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 470/936] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:30.371995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083cba-5058-4dd8-b04a-d83254f39179 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:30.439966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7479f7-ecdf-4e01-a5e8-09796b8ea737 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:30.478499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:30.479492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:30.480003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:30.480613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:30.488220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:30.490323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:30.497001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083cba-5058-4dd8-b04a-d83254f39179 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:30.502697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:30.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:30.504545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:30.504545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:30.504545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:30.504545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:30.504545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:30.504545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:30.504545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:30.504545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:30.507023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 467/937] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:30.512853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:30.535336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf04c4-5704-4704-a5ed-56974f0ef345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:30.536504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf04c4-5704-4704-a5ed-56974f0ef345 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:30.536858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf04c4-5704-4704-a5ed-56974f0ef345 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:30.537760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf04c4-5704-4704-a5ed-56974f0ef345 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:30.549787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf04c4-5704-4704-a5ed-56974f0ef345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-74bf04c4-5704-4704-a5ed-56974f0ef345 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:30.555059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:30.556016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:30.556933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 471/938] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 11:05:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:30.562153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf04c4-5704-4704-a5ed-56974f0ef345 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:30.567439 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:30.639350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:30.661320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f317-ea8c-4eb9-bc30-0747784788cd None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:30.680482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf04c4-5704-4704-a5ed-56974f0ef345 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:30.712888 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:30.714083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:30.714955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:30.715732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:30.716729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:30.717241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:30.719078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:30.719450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:30.720064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:30.720366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:30.720645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:30.721472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:30.722101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:30.725047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:30.739494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 472/939] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 11:05:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:30.741424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:30.746703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 468/940] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:30.840777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:30.884587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723871b-fa41-4b27-ab98-ff73082902cd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:30.921953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:30.922517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:30.922794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:30.923067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:30.935379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:30.936859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:30.952279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:30.953317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:30.954243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:30.954243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:30.954243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:30.958079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 473/941] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:30.960011 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:31.070412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c41d30-5534-4980-9275-ca0aa92f5be5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:31.105797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:31.106773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.107260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.107738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.108628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:31.109238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:31.110818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:31.125093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 469/942] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:31.131253 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:31.239361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7759fc2-604d-4454-9080-463494c99c93 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:31.260600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:31.280102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:31.288079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.288079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.288079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.292062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:31.293743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:31.306006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:31.306979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:31.307935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:31.315887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 474/943] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:05:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:31.317498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:31.326984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:31.428422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7078c94-0eda-4f4d-9ab4-03701554fa4e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:31.463704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a1658-c233-4da1-9ff2-4862c6a72e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:31.464342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1658-c233-4da1-9ff2-4862c6a72e69 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.464702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1658-c233-4da1-9ff2-4862c6a72e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.464978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1658-c233-4da1-9ff2-4862c6a72e69 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.465729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a1658-c233-4da1-9ff2-4862c6a72e69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:31.466026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a1658-c233-4da1-9ff2-4862c6a72e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:31.467462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a1658-c233-4da1-9ff2-4862c6a72e69 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:31.485753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 470/944] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 11:05:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:31.491789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:31.506199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9101a-6c17-49e9-ad07-d3c6dc82fb9a None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.506521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9101a-6c17-49e9-ad07-d3c6dc82fb9a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.506747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9101a-6c17-49e9-ad07-d3c6dc82fb9a None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.508349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 471/945] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:31.513291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60f75-c4a7-494d-a9f8-9c85792f4d96 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.513560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60f75-c4a7-494d-a9f8-9c85792f4d96 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.513829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60f75-c4a7-494d-a9f8-9c85792f4d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.536024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-35c60f75-c4a7-494d-a9f8-9c85792f4d96 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:31.537607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-35c60f75-c4a7-494d-a9f8-9c85792f4d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:31.612681 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:31.616985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8032d9-f03d-4b75-9144-0973a11a37f0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:31.622831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 472/946] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:31.644907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c60f75-c4a7-494d-a9f8-9c85792f4d96 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:31.656458 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:31.657510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.658069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.658490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.671327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:31.673077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:31.689052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:31.690496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:31.691415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:31.691415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:31.691415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:31.701398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 475/947] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:31.704466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:31.746937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:31.761910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c60f75-c4a7-494d-a9f8-9c85792f4d96 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:31.798311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:31.799115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.799471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.799819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.800792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:31.801972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:31.813322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:31.814963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:31.815795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 473/948] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:31.821272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:31.836873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d638d75-03fd-4fbf-8664-49f24df2f628 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:31.876058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:31.876961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.877236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.877525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.878147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:31.878442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:31.879921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:31.892549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:31.898259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 476/949] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:31.899705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:31.950182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24737d-2f98-4849-908d-f1136b805a99 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:31.986497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:31.987459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:31.987932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:31.988455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:31.989302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:31.989808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:31.991394 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.001437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:32.001739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 474/950] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:32.002864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:32.013080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ded515-6721-4d80-af2f-260fe11cdbbb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:32.072349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:32.073298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.073586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.073917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.083076 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:32.085637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:32.100457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:32.101466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:32.102552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 477/951] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:32.107654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:32.138497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6003-670b-46c6-9ecd-cbe39953990e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:32.168896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:32.182808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef751337-a381-4f06-b182-a99813a7b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:32.183929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751337-a381-4f06-b182-a99813a7b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.184799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751337-a381-4f06-b182-a99813a7b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.185480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751337-a381-4f06-b182-a99813a7b9b0 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.186289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef751337-a381-4f06-b182-a99813a7b9b0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:32.186601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef751337-a381-4f06-b182-a99813a7b9b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:32.187963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef751337-a381-4f06-b182-a99813a7b9b0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.193431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 475/952] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:32.194761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33091b-a44a-4819-bdc7-e48035709d77 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.195045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33091b-a44a-4819-bdc7-e48035709d77 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.195416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33091b-a44a-4819-bdc7-e48035709d77 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.197191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 476/953] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:32.201960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bf9fb-8bdd-4d66-9019-910fda7ac261 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.202248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bf9fb-8bdd-4d66-9019-910fda7ac261 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.202522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bf9fb-8bdd-4d66-9019-910fda7ac261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.219744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ef7bf9fb-8bdd-4d66-9019-910fda7ac261 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:32.220992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ef7bf9fb-8bdd-4d66-9019-910fda7ac261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:32.230843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e7138-fc7f-4f10-8796-fe274564d1cd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:32.266372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:32.267307 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.267747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.268017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.268739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:32.269054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:32.270694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.289098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 478/954] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:32.289098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:32.295718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 477/955] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:32.298622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:32.309049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bf9fb-8bdd-4d66-9019-910fda7ac261 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:32.394616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2261d3b-bdbd-4c03-a4b2-c8433b120754 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:32.416919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bf9fb-8bdd-4d66-9019-910fda7ac261 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:32.431227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953193f-f992-4fc7-889e-bb848f6696ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:32.431834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953193f-f992-4fc7-889e-bb848f6696ef None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.432120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953193f-f992-4fc7-889e-bb848f6696ef None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.432420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953193f-f992-4fc7-889e-bb848f6696ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.433082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953193f-f992-4fc7-889e-bb848f6696ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:32.434467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953193f-f992-4fc7-889e-bb848f6696ef None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.435179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:32.453448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674922e-2900-4967-99db-1ad7615357f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:32.454105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674922e-2900-4967-99db-1ad7615357f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.454383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674922e-2900-4967-99db-1ad7615357f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.454652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674922e-2900-4967-99db-1ad7615357f3 None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/b609ab814003472c9579134a5c91ab37/roles/cc7f11a1b669499daed397d417c3111b` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.456790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674922e-2900-4967-99db-1ad7615357f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=b609ab814003472c9579134a5c91ab37, role_id=cc7f11a1b669499daed397d417c3111b)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:32.458212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674922e-2900-4967-99db-1ad7615357f3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.534427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 479/956] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:05:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:32.535251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953193f-f992-4fc7-889e-bb848f6696ef None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:32.571854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 478/957] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:05:32 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/b609ab814003472c9579134a5c91ab37/roles/cc7f11a1b669499daed397d417c3111b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:05:32.627741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:32.680697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953193f-f992-4fc7-889e-bb848f6696ef None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:32.721858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:32.722656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.722950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.723224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.723829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:32.726003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:32.735914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:32.737175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:32.738139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 480/958] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:32.743648 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674922e-2900-4967-99db-1ad7615357f3 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:32.870745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674922e-2900-4967-99db-1ad7615357f3 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:32.907052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1e1e7-f82d-448b-8d40-7404182193d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:32.907942 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e1e7-f82d-448b-8d40-7404182193d2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.908460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e1e7-f82d-448b-8d40-7404182193d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.908881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e1e7-f82d-448b-8d40-7404182193d2 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.909711 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1e1e7-f82d-448b-8d40-7404182193d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:32.910157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1e1e7-f82d-448b-8d40-7404182193d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:32.911798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1e1e7-f82d-448b-8d40-7404182193d2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:32.917977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 479/959] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:32.923869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:32.954291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5386-9d2b-46aa-a9ad-a109ed5afbf2 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.954577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5386-9d2b-46aa-a9ad-a109ed5afbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.954859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5386-9d2b-46aa-a9ad-a109ed5afbf2 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.956622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 480/960] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:32.962390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5318-1013-49db-8e75-67365bde8f8f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:32.962671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5318-1013-49db-8e75-67365bde8f8f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:32.963043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff5318-1013-49db-8e75-67365bde8f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:32.982407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-bdff5318-1013-49db-8e75-67365bde8f8f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:32.983587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-bdff5318-1013-49db-8e75-67365bde8f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:33.022157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:33.052170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2dee6-0550-4f85-b24c-7b7ac59b6bfd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:33.064139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 481/961] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:33.085789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:33.095172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:33.095787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:33.096062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:33.096385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:33.097065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:33.097351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:33.098048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5318-1013-49db-8e75-67365bde8f8f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:33.098702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:33.104268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 481/962] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:33.220386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff5318-1013-49db-8e75-67365bde8f8f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:33.259854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:33.260504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:33.260785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:33.261116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:33.261758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:33.263249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:33.310587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.sql.core [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 11:05:33.310587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 11:05:33.310587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [parameters: {'user_id': '24120f850e4340a5be1d9b14690055b4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 11:05:33.310587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80613) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application conn.query(q) Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result.read() Aug 10 11:05:33.317813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 11:05:33.322925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application next(self.gen) Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application yield resource Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application next(self.gen) Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise self.value Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application session.commit() Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 11:05:33.323920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.session.flush() Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application compat.raise_( Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 11:05:33.324869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 11:05:33.325794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application conn.query(q) Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application result.read() Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 11:05:33.326701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [parameters: {'user_id': '24120f850e4340a5be1d9b14690055b4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:33.327566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 11:05:33.329595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 11:05:33.331754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 11:05:33.331754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 11:05:33.331754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 11:05:33.331754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 11:05:33.331754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 11:05:33.331754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:33.331754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 482/963] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 10 11:05:33 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:33.337197 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:33.445680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca9185-5a0f-4bb6-b03c-d9885cc8d727 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:33.481400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724a3a5-8688-43f4-aaa9-8fafb454869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:33.482390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a3a5-8688-43f4-aaa9-8fafb454869e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:33.482878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a3a5-8688-43f4-aaa9-8fafb454869e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:33.483356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a3a5-8688-43f4-aaa9-8fafb454869e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:33.491782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724a3a5-8688-43f4-aaa9-8fafb454869e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:33.493527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724a3a5-8688-43f4-aaa9-8fafb454869e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f724a3a5-8688-43f4-aaa9-8fafb454869e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:33.505039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:33.506106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 11:05:33.507106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:33.509582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 482/964] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:33.515693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:33.551711 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:33.628342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb30694-e257-461a-9b55-e2513ff7ce28 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:33.668445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e59a-c9d2-47ee-b41a-c3bfcec3a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:33.669399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e59a-c9d2-47ee-b41a-c3bfcec3a356 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:33.669902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e59a-c9d2-47ee-b41a-c3bfcec3a356 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:33.670441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e59a-c9d2-47ee-b41a-c3bfcec3a356 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:33.671465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e59a-c9d2-47ee-b41a-c3bfcec3a356 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:33.671969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e59a-c9d2-47ee-b41a-c3bfcec3a356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:33.673813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e59a-c9d2-47ee-b41a-c3bfcec3a356 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:33.714301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 483/965] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 10 11:05:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:34.643271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd13e65-dc9b-4fb8-91a9-e17384ca14f3 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:34.643802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd13e65-dc9b-4fb8-91a9-e17384ca14f3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:34.643802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd13e65-dc9b-4fb8-91a9-e17384ca14f3 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:34.645142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 483/966] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:34.651119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ab35-e15a-4c53-9b83-88a2d8e22893 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:34.651573 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ab35-e15a-4c53-9b83-88a2d8e22893 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:34.651655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441ab35-e15a-4c53-9b83-88a2d8e22893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:34.669809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c441ab35-e15a-4c53-9b83-88a2d8e22893 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:34.671284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c441ab35-e15a-4c53-9b83-88a2d8e22893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:34.707940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299c4c-b2f6-459f-bd17-a9b45e70e386 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:34.708263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299c4c-b2f6-459f-bd17-a9b45e70e386 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:34.709066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299c4c-b2f6-459f-bd17-a9b45e70e386 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:34.710524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 484/967] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:34.715242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529618c-fc15-4d01-beab-872fae08ff57 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:34.715531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529618c-fc15-4d01-beab-872fae08ff57 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:34.715805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529618c-fc15-4d01-beab-872fae08ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:34.733165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e529618c-fc15-4d01-beab-872fae08ff57 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:34.734322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e529618c-fc15-4d01-beab-872fae08ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:34.736914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 484/968] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:34.758844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441ab35-e15a-4c53-9b83-88a2d8e22893 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:34.780542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:34.783694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:34.804428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 485/969] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:34.827994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529618c-fc15-4d01-beab-872fae08ff57 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:34.868217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441ab35-e15a-4c53-9b83-88a2d8e22893 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:34.904071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:34.904643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:34.904917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:34.905434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:34.906081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:34.907447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:34.916857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:34.917906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:34.918774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 485/970] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:34.923648 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:34.932205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529618c-fc15-4d01-beab-872fae08ff57 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:34.966177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68967ba2-86ff-44fa-98f1-a12b6e5d3ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:34.966808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68967ba2-86ff-44fa-98f1-a12b6e5d3ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:34.967080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68967ba2-86ff-44fa-98f1-a12b6e5d3ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:34.967346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68967ba2-86ff-44fa-98f1-a12b6e5d3ca5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:34.977569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68967ba2-86ff-44fa-98f1-a12b6e5d3ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-68967ba2-86ff-44fa-98f1-a12b6e5d3ca5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:34.982199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:34.983141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:34.983982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 486/971] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 11:05:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:34.989074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68967ba2-86ff-44fa-98f1-a12b6e5d3ca5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.013764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.029945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca3746-253a-4439-95a5-7d749688dbb6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.032718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.066490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.067130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.067390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.067733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.068935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:35.069205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.070574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.076065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 486/972] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:35.081931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.097558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68967ba2-86ff-44fa-98f1-a12b6e5d3ca5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.134204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.134824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.135105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.135376 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.136064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:35.136372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.137724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.145801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 487/973] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 11:05:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:35.151274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.191675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26bc8-cbae-4793-9d2f-4757c590311d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.227351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dd572-7e14-4c40-a9a9-344cf192a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.227956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dd572-7e14-4c40-a9a9-344cf192a4dd None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.228234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dd572-7e14-4c40-a9a9-344cf192a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.228542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dd572-7e14-4c40-a9a9-344cf192a4dd None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.229165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dd572-7e14-4c40-a9a9-344cf192a4dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:35.229463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dd572-7e14-4c40-a9a9-344cf192a4dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.230818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dd572-7e14-4c40-a9a9-344cf192a4dd None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.235581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 487/974] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:35.236725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfbbd-89cf-47b6-b095-01774607f94d None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.237004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfbbd-89cf-47b6-b095-01774607f94d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.237271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfbbd-89cf-47b6-b095-01774607f94d None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.238439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 488/975] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:35.243827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfbbd-89cf-47b6-b095-01774607f94d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.254800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead1d9-dfc8-43ee-b0da-c9d57fe8a4b8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.256937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.258071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.289733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ecc74-e652-462d-bc61-aa6306431fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.290366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ecc74-e652-462d-bc61-aa6306431fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.290644 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ecc74-e652-462d-bc61-aa6306431fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.290914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ecc74-e652-462d-bc61-aa6306431fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.300713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ecc74-e652-462d-bc61-aa6306431fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.302207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ecc74-e652-462d-bc61-aa6306431fb7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-519ecc74-e652-462d-bc61-aa6306431fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:35.316500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:35.317475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:35.319200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:35.319200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:35.319200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:35.319200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 488/976] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:35.319442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac53b-567f-4dec-8c35-3b67652246ee None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.319753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac53b-567f-4dec-8c35-3b67652246ee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.319860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac53b-567f-4dec-8c35-3b67652246ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.337604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-485ac53b-567f-4dec-8c35-3b67652246ee None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:35.339097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-485ac53b-567f-4dec-8c35-3b67652246ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:35.347204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfbbd-89cf-47b6-b095-01774607f94d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.379923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.385059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.385059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.385059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.385059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] RBAC: Adding query filter params (interface=admin, service_id=5c0eeb10651644d18f0de14ce6d51586, region_id=RegionOne) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:35.385059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.385059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.388948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 489/977] 10.222.0.40 () {56 vars in 1249 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/endpoints?service_id=5c0eeb10651644d18f0de14ce6d51586&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:35.393239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.404855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 489/978] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:35.405940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ac53b-567f-4dec-8c35-3b67652246ee None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.473837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.488742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.496015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2607862-917c-4679-9982-ce2672ca8ec0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.503534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ac53b-567f-4dec-8c35-3b67652246ee None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.530852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.531456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.531729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.532043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.532755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:35.533054 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.534409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.537987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e0db0-fcc9-457f-8ba8-863c454bd85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.538602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0db0-fcc9-457f-8ba8-863c454bd85a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.538884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0db0-fcc9-457f-8ba8-863c454bd85a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.539155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0db0-fcc9-457f-8ba8-863c454bd85a None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.539761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e0db0-fcc9-457f-8ba8-863c454bd85a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.541136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e0db0-fcc9-457f-8ba8-863c454bd85a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.549908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 490/979] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:35.549908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.550160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 490/980] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/services => generated 1497 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:05:35.550842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e0db0-fcc9-457f-8ba8-863c454bd85a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.666991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320d63f-5f69-4781-ac24-87226fcfdd3b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.670634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e0db0-fcc9-457f-8ba8-863c454bd85a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.704301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e15f0-db0b-4c74-bb90-912d0aecfa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.704951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e15f0-db0b-4c74-bb90-912d0aecfa11 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.705227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e15f0-db0b-4c74-bb90-912d0aecfa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.706098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e15f0-db0b-4c74-bb90-912d0aecfa11 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.706098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e15f0-db0b-4c74-bb90-912d0aecfa11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.707450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e15f0-db0b-4c74-bb90-912d0aecfa11 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.713136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.714658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.714658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.714951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.715182 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.722755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:35.743067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:35.744064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 491/981] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:35.745113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:35.754741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:35.802944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 491/982] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:05:35 2022] POST /identity/v3/services => generated 242 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:35.850823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9943bc6-049f-4012-8224-60a4420e652f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:35.898023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:35.898814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:35.899097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:35.899371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:35.900125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:35.900504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:35.901966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:35.927172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 492/983] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:35.928993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e15f0-db0b-4c74-bb90-912d0aecfa11 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:36.037626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e15f0-db0b-4c74-bb90-912d0aecfa11 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:36.071914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd030f91-53d3-4d8c-8845-d27584996039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:36.072547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030f91-53d3-4d8c-8845-d27584996039 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:36.072825 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030f91-53d3-4d8c-8845-d27584996039 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:36.073091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030f91-53d3-4d8c-8845-d27584996039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:36.134226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:36.141232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd030f91-53d3-4d8c-8845-d27584996039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:36.142669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd030f91-53d3-4d8c-8845-d27584996039 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:36.243960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 492/984] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:35 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:36.245478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:36.309330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:36.347731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66547-b0ce-4008-a067-7ee116b5ef90 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:36.381847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:36.382470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:36.382746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:36.383014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:36.393276 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:36.394694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:36.409146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:36.410125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:36.411070 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:36.411070 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:36.411070 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:36.412465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 493/985] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:36.416145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd030f91-53d3-4d8c-8845-d27584996039 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:36.511656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:36.517954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd030f91-53d3-4d8c-8845-d27584996039 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:36.554548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:36.555163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:36.555444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:36.555713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:36.556381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:36.556688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:36.558042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:36.574661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 493/986] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:36.576055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:36.679923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76076f-047f-4663-943c-2b9834bc0ea9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:36.695636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:36.716115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:36.716784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:36.718005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:36.718199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:36.728815 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:36.730255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:36.743496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:36.744662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:36.745583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 494/987] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:36.751840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:36.857698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb679d-0d04-403e-9a1f-c5972ff2a955 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:36.890854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631df80-9c98-49e2-9f25-a2b6fab3c712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:36.891457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631df80-9c98-49e2-9f25-a2b6fab3c712 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:36.891731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631df80-9c98-49e2-9f25-a2b6fab3c712 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:36.892000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631df80-9c98-49e2-9f25-a2b6fab3c712 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:36.892709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631df80-9c98-49e2-9f25-a2b6fab3c712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:36.893018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631df80-9c98-49e2-9f25-a2b6fab3c712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:36.894432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631df80-9c98-49e2-9f25-a2b6fab3c712 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:36.911143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 494/988] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:36.912987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:37.013448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbce6dd-b009-4490-90a5-628996b1d951 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:37.047226 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448e80-8ed0-415d-8487-c08d76bfc932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:37.047835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448e80-8ed0-415d-8487-c08d76bfc932 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.048108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448e80-8ed0-415d-8487-c08d76bfc932 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.048403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448e80-8ed0-415d-8487-c08d76bfc932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.049123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2448e80-8ed0-415d-8487-c08d76bfc932 None admin] RBAC: Adding query filter params (role.id=cc7f11a1b669499daed397d417c3111b, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=b609ab814003472c9579134a5c91ab37) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:37.049429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2448e80-8ed0-415d-8487-c08d76bfc932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:37.050827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2448e80-8ed0-415d-8487-c08d76bfc932 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:37.064558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 495/989] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:36 2022] GET /identity/v3/role_assignments?user.id=b609ab814003472c9579134a5c91ab37&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=cc7f11a1b669499daed397d417c3111b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:37.592796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac76b-0843-4473-9b38-bf7ba345b5ca None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.593137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac76b-0843-4473-9b38-bf7ba345b5ca None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.593406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac76b-0843-4473-9b38-bf7ba345b5ca None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.594709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 495/990] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:37.600172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1a8ac-363a-4e42-bc20-100c80c7277f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.600487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1a8ac-363a-4e42-bc20-100c80c7277f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.600769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1a8ac-363a-4e42-bc20-100c80c7277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.618947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d9c1a8ac-363a-4e42-bc20-100c80c7277f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:37.620129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9c1a8ac-363a-4e42-bc20-100c80c7277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:37.650915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:37.691379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 496/991] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:37.713357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac76b-0843-4473-9b38-bf7ba345b5ca None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:37.732007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:37.826056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac76b-0843-4473-9b38-bf7ba345b5ca None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:37.861440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:37.861994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.862270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.862538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.863118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:37.864669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:37.868810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87365-fc6b-4375-b2ed-bba9849046c8 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.869095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87365-fc6b-4375-b2ed-bba9849046c8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.869365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87365-fc6b-4375-b2ed-bba9849046c8 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.870927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 497/992] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:37.873782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:37.874859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:37.875820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 496/993] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 10 11:05:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:37.878487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70955b7-d722-484b-bb9e-f1ffcfd1e28a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:37.878874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70955b7-d722-484b-bb9e-f1ffcfd1e28a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:37.879288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70955b7-d722-484b-bb9e-f1ffcfd1e28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:37.880495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:37.897680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e70955b7-d722-484b-bb9e-f1ffcfd1e28a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:37.898955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e70955b7-d722-484b-bb9e-f1ffcfd1e28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:37.965498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:37.968736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 498/994] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:37.984774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1b37d-c80d-476f-b448-e6f907b73c74 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:37.991990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70955b7-d722-484b-bb9e-f1ffcfd1e28a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:38.024597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:38.025207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:38.025485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:38.025754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:38.026383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:38.026717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:38.028509 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:38.038612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 497/995] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:38.039909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:38.110839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:38.115506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70955b7-d722-484b-bb9e-f1ffcfd1e28a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:38.148809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6951951-ab70-4f52-ab38-d64b1a9f9050 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:38.154101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:38.154846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:38.155423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:38.155699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:38.156293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:38.157875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:38.168908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:38.170191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:38.171089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 499/996] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:38.175944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:38.199608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:38.200287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:38.200583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:38.200850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:38.201483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:38.201786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:38.203157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:38.208367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 498/997] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 10 11:05:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:38.215841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:38.228840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:38.303432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d029176-5c5f-4401-be1a-28a089f3787f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:38.343551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:38.344052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa31d2-9f8d-4187-9521-874d72a539f4 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:38.344179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:38.344485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:38.344757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:38.345399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:38.345776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:38.347227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:38.360045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 500/998] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:38.362008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:38.391729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443df2a-f900-45f3-b8e0-82ca4acf40ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:38.399837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443df2a-f900-45f3-b8e0-82ca4acf40ec None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:38.399837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443df2a-f900-45f3-b8e0-82ca4acf40ec None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:38.399837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443df2a-f900-45f3-b8e0-82ca4acf40ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:38.399837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443df2a-f900-45f3-b8e0-82ca4acf40ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:38.399837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443df2a-f900-45f3-b8e0-82ca4acf40ec None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:38.401118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:38.479419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d559b-2781-4b02-9e74-0278ffb9654a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:38.496487 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 499/999] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:05:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:05:38.538335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:38.538975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:38.539295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:38.539770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:38.540900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:38.541207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:38.543346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:38.551253 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 501/1000] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:38.558010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443df2a-f900-45f3-b8e0-82ca4acf40ec None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:38.638215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:38.680424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443df2a-f900-45f3-b8e0-82ca4acf40ec None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:38.727264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334d70c-9499-470a-8ae3-9ae10aa07dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:38.727885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d70c-9499-470a-8ae3-9ae10aa07dae None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:38.728161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d70c-9499-470a-8ae3-9ae10aa07dae None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:38.728467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d70c-9499-470a-8ae3-9ae10aa07dae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:38.729168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334d70c-9499-470a-8ae3-9ae10aa07dae None admin] RBAC: Adding query filter params (interface=public, service_id=17a3568b95e642a7883270b66e1ce72a, region_id=RegionOne) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:38.729471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334d70c-9499-470a-8ae3-9ae10aa07dae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:38.731267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334d70c-9499-470a-8ae3-9ae10aa07dae None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:38.737935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 500/1001] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 11:05:38 2022] GET /identity/v3/endpoints?service_id=17a3568b95e642a7883270b66e1ce72a&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:38.743834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:38.851029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:38.867759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdddc95-1483-4242-aebb-e6299bc81f75 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:38.908171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ce8be-f803-4efd-8654-fb8464778776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:38.908862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ce8be-f803-4efd-8654-fb8464778776 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:38.909141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ce8be-f803-4efd-8654-fb8464778776 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:38.909460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ce8be-f803-4efd-8654-fb8464778776 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:38.910072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ce8be-f803-4efd-8654-fb8464778776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:38.911494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ce8be-f803-4efd-8654-fb8464778776 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:38.932427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 502/1002] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:05:38 2022] GET /identity/v3/services => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:05:39.154822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d560d6-a030-4613-b639-ab3b2e051f67 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:39.155610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d560d6-a030-4613-b639-ab3b2e051f67 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:39.155610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d560d6-a030-4613-b639-ab3b2e051f67 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:39.157114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 501/1003] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:39.162177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c77152-d9f1-4a16-9240-58bad9338da8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:39.162462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c77152-d9f1-4a16-9240-58bad9338da8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:39.162741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c77152-d9f1-4a16-9240-58bad9338da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:39.180728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-92c77152-d9f1-4a16-9240-58bad9338da8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:39.181899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-92c77152-d9f1-4a16-9240-58bad9338da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:39.249295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 503/1004] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:39.272216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d560d6-a030-4613-b639-ab3b2e051f67 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:39.372419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d560d6-a030-4613-b639-ab3b2e051f67 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:39.402507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:39.407636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:39.408279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:39.408582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:39.408853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] PATH_INFO: `/v3/services/image` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:39.409433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:39.410786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:39.420042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:39.421556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:39.422426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:39.424651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 502/1005] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 10 11:05:39 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:39.427155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c77152-d9f1-4a16-9240-58bad9338da8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:39.508875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:39.528323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c77152-d9f1-4a16-9240-58bad9338da8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:39.562786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598623-4381-436c-b406-4118a13f4d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:39.563401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598623-4381-436c-b406-4118a13f4d3f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:39.563678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598623-4381-436c-b406-4118a13f4d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:39.563946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598623-4381-436c-b406-4118a13f4d3f None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:39.564599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598623-4381-436c-b406-4118a13f4d3f None admin] RBAC: Adding query filter params (name=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:39.564902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598623-4381-436c-b406-4118a13f4d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:39.566248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598623-4381-436c-b406-4118a13f4d3f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:39.575653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 504/1006] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:39.576942 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:39.678336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccf0f3-6c92-45cd-9f4f-05e5572a2b32 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:39.714729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3afe9-b512-432f-8728-fd906999f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:39.715345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3afe9-b512-432f-8728-fd906999f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:39.715624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3afe9-b512-432f-8728-fd906999f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:39.715897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3afe9-b512-432f-8728-fd906999f6f1 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:39.716686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3afe9-b512-432f-8728-fd906999f6f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:39.716994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3afe9-b512-432f-8728-fd906999f6f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:39.718357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3afe9-b512-432f-8728-fd906999f6f1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:39.728390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 503/1007] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:40.659617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7dc8c-7fa4-4193-a8de-5b0cf1e2e7a4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:40.660194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7dc8c-7fa4-4193-a8de-5b0cf1e2e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:40.660194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7dc8c-7fa4-4193-a8de-5b0cf1e2e7a4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:40.661541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 505/1008] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:40.666986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d82de-2238-42cd-bfa4-bbd7d9b63ed4 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:40.667370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d82de-2238-42cd-bfa4-bbd7d9b63ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:40.667548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d82de-2238-42cd-bfa4-bbd7d9b63ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:40.685561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-629d82de-2238-42cd-bfa4-bbd7d9b63ed4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:40.686737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-629d82de-2238-42cd-bfa4-bbd7d9b63ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:40.743077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:40.754215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 504/1009] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:40.778580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7dc8c-7fa4-4193-a8de-5b0cf1e2e7a4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:40.890171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7dc8c-7fa4-4193-a8de-5b0cf1e2e7a4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:40.925207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8cdf3-017d-43d8-aa8f-1f31453629c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:40.925766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8cdf3-017d-43d8-aa8f-1f31453629c1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:40.926045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8cdf3-017d-43d8-aa8f-1f31453629c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:40.926316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8cdf3-017d-43d8-aa8f-1f31453629c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:40.927587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8cdf3-017d-43d8-aa8f-1f31453629c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:40.929036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8cdf3-017d-43d8-aa8f-1f31453629c1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:40.930742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 506/1010] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:40.933318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3b6a1-201d-4b67-91f4-224462af2c93 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:40.933603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3b6a1-201d-4b67-91f4-224462af2c93 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:40.933872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3b6a1-201d-4b67-91f4-224462af2c93 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:40.935299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 505/1011] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:40.936334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8cdf3-017d-43d8-aa8f-1f31453629c1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:40.939728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf741b7-f634-4c7a-b1aa-3dc5ab1fc9a7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:40.940012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf741b7-f634-4c7a-b1aa-3dc5ab1fc9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:40.940284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf741b7-f634-4c7a-b1aa-3dc5ab1fc9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:40.951113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:40.961800 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-6cf741b7-f634-4c7a-b1aa-3dc5ab1fc9a7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:40.963278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6cf741b7-f634-4c7a-b1aa-3dc5ab1fc9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:41.036207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 506/1012] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:41.042118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8cdf3-017d-43d8-aa8f-1f31453629c1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:41.058963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf741b7-f634-4c7a-b1aa-3dc5ab1fc9a7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:41.077688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb381df-01bf-423b-8376-3f526e127f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:41.078298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb381df-01bf-423b-8376-3f526e127f2b None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:41.078574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb381df-01bf-423b-8376-3f526e127f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:41.078851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb381df-01bf-423b-8376-3f526e127f2b None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:41.079483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb381df-01bf-423b-8376-3f526e127f2b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:41.080908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb381df-01bf-423b-8376-3f526e127f2b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:41.158161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf741b7-f634-4c7a-b1aa-3dc5ab1fc9a7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:41.179804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:41.193646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:41.194267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:41.194543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:41.194807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] PATH_INFO: `/v3/services/compute` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:41.195554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:41.196936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:41.204715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 507/1013] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:05:40 2022] POST /identity/v3/projects => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:41.207100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:41.208107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:41.209012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 507/1014] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:41.214103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb381df-01bf-423b-8376-3f526e127f2b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:41.280621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:41.321460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb381df-01bf-423b-8376-3f526e127f2b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:41.357543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:41.358169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:41.358448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:41.358719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:41.359363 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:41.359663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:41.361146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:41.371881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 508/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:41.373488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:41.479423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b37fd-ed4f-4fbc-9154-ec0f01cd9cde None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:41.513513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0484e-8109-4d53-9415-a6b63475b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:41.514129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0484e-8109-4d53-9415-a6b63475b77e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:41.514408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0484e-8109-4d53-9415-a6b63475b77e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:41.514683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0484e-8109-4d53-9415-a6b63475b77e None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:41.515313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0484e-8109-4d53-9415-a6b63475b77e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:41.515615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0484e-8109-4d53-9415-a6b63475b77e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:41.516997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0484e-8109-4d53-9415-a6b63475b77e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:41.521936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 508/1016] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 10 11:05:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:41.527710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:41.630600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1e37-08ba-4648-93ad-026a4fafe2c1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:41.656879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:41.665611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69906c-3810-497b-8c6e-6dd403dcd1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:41.670732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69906c-3810-497b-8c6e-6dd403dcd1a1 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:41.670732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69906c-3810-497b-8c6e-6dd403dcd1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:41.670732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69906c-3810-497b-8c6e-6dd403dcd1a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:41.670732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69906c-3810-497b-8c6e-6dd403dcd1a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:41.670732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69906c-3810-497b-8c6e-6dd403dcd1a1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:41.727904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4077-1d8e-4dd5-8b66-660f0c532287 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:41.728473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4077-1d8e-4dd5-8b66-660f0c532287 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:41.728584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf4077-1d8e-4dd5-8b66-660f0c532287 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:41.729966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 509/1017] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:41.734748 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03f8f-a616-4c7c-b90b-984fe4249518 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:41.735585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03f8f-a616-4c7c-b90b-984fe4249518 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:41.735585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03f8f-a616-4c7c-b90b-984fe4249518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:41.740714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 509/1018] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:05:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:41.754593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-4da03f8f-a616-4c7c-b90b-984fe4249518 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:41.755882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4da03f8f-a616-4c7c-b90b-984fe4249518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:41.808371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:41.852494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 510/1019] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:41 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:41.872201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69906c-3810-497b-8c6e-6dd403dcd1a1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:41.980769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69906c-3810-497b-8c6e-6dd403dcd1a1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:42.016593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb142bf2-2894-4fff-82c5-578f691c8854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:42.017215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb142bf2-2894-4fff-82c5-578f691c8854 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:42.017495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb142bf2-2894-4fff-82c5-578f691c8854 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:42.017775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb142bf2-2894-4fff-82c5-578f691c8854 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:42.018436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb142bf2-2894-4fff-82c5-578f691c8854 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:42.019805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb142bf2-2894-4fff-82c5-578f691c8854 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:42.128042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 510/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:05:41 2022] POST /identity/v3/services => generated 242 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:05:43.290776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce51a-fc74-40b5-a2de-7741dc60364c None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:43.291337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce51a-fc74-40b5-a2de-7741dc60364c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:43.291337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce51a-fc74-40b5-a2de-7741dc60364c None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:43.292826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 511/1021] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:43.297917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011e9e-270e-4c9e-ab0b-547df5a93ef5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:43.298303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011e9e-270e-4c9e-ab0b-547df5a93ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:43.298479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011e9e-270e-4c9e-ab0b-547df5a93ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:43.316916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3d011e9e-270e-4c9e-ab0b-547df5a93ef5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:43.318696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3d011e9e-270e-4c9e-ab0b-547df5a93ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:43.358905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:43.391001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 511/1022] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:43.415166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce51a-fc74-40b5-a2de-7741dc60364c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:43.516104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce51a-fc74-40b5-a2de-7741dc60364c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:43.549482 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174303-e81a-4288-af0f-8c46b51045ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:43.550089 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174303-e81a-4288-af0f-8c46b51045ac None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:43.550364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174303-e81a-4288-af0f-8c46b51045ac None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:43.550635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174303-e81a-4288-af0f-8c46b51045ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:43.552374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0174303-e81a-4288-af0f-8c46b51045ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:43.553922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0174303-e81a-4288-af0f-8c46b51045ac None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:43.555678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 512/1023] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:43.561392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d011e9e-270e-4c9e-ab0b-547df5a93ef5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:43.658525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d011e9e-270e-4c9e-ab0b-547df5a93ef5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:43.692561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0210193-8b1c-45be-9a68-c77d8063fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:43.693173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210193-8b1c-45be-9a68-c77d8063fc65 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:43.693448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210193-8b1c-45be-9a68-c77d8063fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:43.693713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210193-8b1c-45be-9a68-c77d8063fc65 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:43.694371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0210193-8b1c-45be-9a68-c77d8063fc65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:43.695779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0210193-8b1c-45be-9a68-c77d8063fc65 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:43.796347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 512/1024] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:05:43 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:05:43.878898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886b42-6d10-45db-b418-7944611fb931 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:43.879182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886b42-6d10-45db-b418-7944611fb931 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:43.879501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886b42-6d10-45db-b418-7944611fb931 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:43.881882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 513/1025] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:43.887629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507e31-70e3-4fad-98f3-64a7b47642c4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:43.887918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507e31-70e3-4fad-98f3-64a7b47642c4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:43.888192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507e31-70e3-4fad-98f3-64a7b47642c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:43.907100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d1507e31-70e3-4fad-98f3-64a7b47642c4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:43.908320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d1507e31-70e3-4fad-98f3-64a7b47642c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:43.931383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:43.983714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 513/1026] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:44.008436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f886b42-6d10-45db-b418-7944611fb931 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.057433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:44.116230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f886b42-6d10-45db-b418-7944611fb931 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.150595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bcaff-d648-4c9e-bbac-a53a4d4c23c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.151228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bcaff-d648-4c9e-bbac-a53a4d4c23c9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.151505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bcaff-d648-4c9e-bbac-a53a4d4c23c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.151772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bcaff-d648-4c9e-bbac-a53a4d4c23c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.162730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bcaff-d648-4c9e-bbac-a53a4d4c23c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:44.166121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a3eb-4855-46ad-9d52-a6f49c5a0f2d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.166413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a3eb-4855-46ad-9d52-a6f49c5a0f2d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.166691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a3eb-4855-46ad-9d52-a6f49c5a0f2d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-d37bcaff-d648-4c9e-bbac-a53a4d4c23c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:44.167494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:44.168689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:44.170136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:44.170996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 514/1027] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:44.171078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 514/1028] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:44.173028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc12cf-c39b-4ae2-b1f0-17155ce20b3c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.173316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc12cf-c39b-4ae2-b1f0-17155ce20b3c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.173590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc12cf-c39b-4ae2-b1f0-17155ce20b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.177325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bcaff-d648-4c9e-bbac-a53a4d4c23c9 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.195076 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-96bc12cf-c39b-4ae2-b1f0-17155ce20b3c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:44.196763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-96bc12cf-c39b-4ae2-b1f0-17155ce20b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:44.276383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 515/1029] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:44.279401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bcaff-d648-4c9e-bbac-a53a4d4c23c9 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.281212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:44.295249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc12cf-c39b-4ae2-b1f0-17155ce20b3c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.316761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.318403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.319136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.319594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.320660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:44.321456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:44.323420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:44.334208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 515/1030] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:44.339384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.388224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:44.403435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc12cf-c39b-4ae2-b1f0-17155ce20b3c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.440354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.440996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.441271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.441539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] PATH_INFO: `/v3/services/image` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.442184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:44.443520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:44.449144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cac4b8-9fbe-48a5-9ca0-379f51648fd5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:44.452155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:44.456608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:44.457694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 516/1031] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:44.459569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.492970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.493597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.493870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.494136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.508701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:44.510884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:44.527077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:44.528104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:44.529341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:44.529341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:44.529341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:44.529341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 516/1032] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:44.534848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.554662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:44.567123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d97f7-f715-4400-b050-99ffcbba4124 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.604604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.605221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.605500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.605772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.606405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:44.606708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:44.608059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:44.618604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 517/1033] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:44.619846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.636545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:44.647858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8c6a-d80d-4357-9a31-9a02e75dddfe None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.682606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.683215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.683501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.683773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.684427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:44.684727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:44.686086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:44.697337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 517/1034] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:44.702845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.734172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9238fb4-225d-4c3c-b1a8-feaa1f17ccf5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.769099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.769795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.770764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.771119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.771847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] RBAC: Adding query filter params (type=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:44.772261 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:44.773736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:44.778837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 518/1035] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:44.784506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.786688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:44.810473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7608-d506-4894-8e4e-e0df4dc03489 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.850182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.850964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.851337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.851675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.859898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:44.861442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:44.871528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:44.876121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:44.883443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 518/1036] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:44.884489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.894207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf61a3-d048-495b-a884-6c2132348a3d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:44.931985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:44.932961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:44.933523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:44.934135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:44.934937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] RBAC: Adding query filter params (interface=public, service_id=b3ad9d2961e14f01aa82de8e121e1b90, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:44.935254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:44.936631 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:44.943164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 519/1037] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/endpoints?service_id=b3ad9d2961e14f01aa82de8e121e1b90&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:44.948358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:44.990429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42168-a09c-4d57-92a3-3b1a03eeac9d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:45.026988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:45.027604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:45.027881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:45.028150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:45.028987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:45.029351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:45.031111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:45.033749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:45.054468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 519/1038] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:45.055489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:45.059943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf33b5-05a6-4a2e-9f19-fac9d90feda0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:45.096140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dbc19-c20d-46d7-bcba-f11e4f9c7668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:45.096790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dbc19-c20d-46d7-bcba-f11e4f9c7668 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:45.097481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dbc19-c20d-46d7-bcba-f11e4f9c7668 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:45.097764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dbc19-c20d-46d7-bcba-f11e4f9c7668 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:45.098902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dbc19-c20d-46d7-bcba-f11e4f9c7668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:45.100655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dbc19-c20d-46d7-bcba-f11e4f9c7668 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:45.107830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 520/1039] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:05:44 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:05:45.171660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d58f65-6a47-43d2-b119-ee99581baf01 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:45.209717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc6b6-126e-429c-a443-9a31a81d5001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:45.210265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc6b6-126e-429c-a443-9a31a81d5001 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:45.210549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc6b6-126e-429c-a443-9a31a81d5001 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:45.210824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc6b6-126e-429c-a443-9a31a81d5001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:45.278740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:45.287419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc6b6-126e-429c-a443-9a31a81d5001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:45.288900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc6b6-126e-429c-a443-9a31a81d5001 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:45.391435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 520/1040] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:45.397804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dbc19-c20d-46d7-bcba-f11e4f9c7668 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:45.407850 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:45.499464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dbc19-c20d-46d7-bcba-f11e4f9c7668 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:45.532751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:45.533383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:45.533657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:45.533927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:45.544406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:45.545836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:45.560146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:45.561185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:45.562139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:45.562139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:45.562139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:45.562899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 521/1041] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:45.568334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc6b6-126e-429c-a443-9a31a81d5001 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:45.663294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:45.670024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc6b6-126e-429c-a443-9a31a81d5001 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:45.704186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:45.704882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:45.705165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:45.705436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:45.706068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:45.706371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:45.707870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:45.724002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 521/1042] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:45.725436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:45.787749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:45.835486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9076afa-07d1-4002-a1a7-0dbd48c8b9ae None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:45.870057 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52e715-3429-404b-acd1-fe8d96caf3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:45.870715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52e715-3429-404b-acd1-fe8d96caf3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:45.871002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52e715-3429-404b-acd1-fe8d96caf3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:45.871257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52e715-3429-404b-acd1-fe8d96caf3c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:45.877868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52e715-3429-404b-acd1-fe8d96caf3c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:45.879332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52e715-3429-404b-acd1-fe8d96caf3c6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bc52e715-3429-404b-acd1-fe8d96caf3c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:45.890269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:45.891173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:45.892075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:45.892075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:45.892075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:45.892075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:45.892075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:45.892075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:45.892075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:45.892075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:45.896125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 522/1043] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:45.897349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:45.938820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf628-d14b-4de1-851f-246b1ad2fc54 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:45.939121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf628-d14b-4de1-851f-246b1ad2fc54 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:45.939382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf628-d14b-4de1-851f-246b1ad2fc54 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:45.940735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 523/1044] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:45.946164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495b02-16ef-489b-8959-b2d44bbaa934 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:45.946453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495b02-16ef-489b-8959-b2d44bbaa934 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:45.946731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70495b02-16ef-489b-8959-b2d44bbaa934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:45.964977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-70495b02-16ef-489b-8959-b2d44bbaa934 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:45.966150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-70495b02-16ef-489b-8959-b2d44bbaa934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:46.003422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022c3f-162c-4361-8ba2-4dbd85135bfb None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:46.034345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 524/1045] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:46.038856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:46.039404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:46.039679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:46.039948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:46.040665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:46.041016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:46.042444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:46.055660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 522/1046] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:46.058665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495b02-16ef-489b-8959-b2d44bbaa934 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:46.061264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:46.077189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:46.112328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:46.169091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33f644-6e31-40fc-9947-c86e4a91c598 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:46.169434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70495b02-16ef-489b-8959-b2d44bbaa934 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:46.207845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:46.208528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:46.208638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575a56-c9fa-46bc-b5fa-f1445d8026e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:46.208842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:46.209075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:46.209800 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] RBAC: Adding query filter params (role.id=cc7f11a1b669499daed397d417c3111b, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=e64f4c342e714597b6c628ca022d7b9a) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:46.210055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575a56-c9fa-46bc-b5fa-f1445d8026e6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:46.210158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:46.210622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575a56-c9fa-46bc-b5fa-f1445d8026e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:46.211083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575a56-c9fa-46bc-b5fa-f1445d8026e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:46.211522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:46.217578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 523/1047] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:46 2022] GET /identity/v3/role_assignments?user.id=e64f4c342e714597b6c628ca022d7b9a&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=cc7f11a1b669499daed397d417c3111b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:46.233429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea575a56-c9fa-46bc-b5fa-f1445d8026e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ea575a56-c9fa-46bc-b5fa-f1445d8026e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:46.238483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:46.240245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:46.241159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:46.244771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 525/1048] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:46.246512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:46.333743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:46.356819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b925a77-2635-4d13-b363-67ffba311e4d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:46.393440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:46.394158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:46.394431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:46.394597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:46.395283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:46.395559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:46.396948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:46.406992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 524/1049] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:46.412838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575a56-c9fa-46bc-b5fa-f1445d8026e6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:46.514105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575a56-c9fa-46bc-b5fa-f1445d8026e6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:46.523733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:46.548476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbe90e-a6f6-4bff-b0c0-d2694f66b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:46.549108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbe90e-a6f6-4bff-b0c0-d2694f66b83a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:46.549385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbe90e-a6f6-4bff-b0c0-d2694f66b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:46.549656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbe90e-a6f6-4bff-b0c0-d2694f66b83a None admin] PATH_INFO: `/v3/users/b1a6428f0bbe45eda5167cea7692aca7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:46.564553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbe90e-a6f6-4bff-b0c0-d2694f66b83a None admin] RBAC: Authorizing `identity:get_user(user_id=b1a6428f0bbe45eda5167cea7692aca7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:46.566011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbe90e-a6f6-4bff-b0c0-d2694f66b83a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:46.568135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 526/1050] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:05:46 2022] GET /identity/v3/users/b1a6428f0bbe45eda5167cea7692aca7 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:46.573794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:46.676900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74625c-b0b6-4ce2-a673-cf9b64180f9a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:46.710009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d792b4-5370-4f44-8b1d-b5d1178d8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:46.710611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d792b4-5370-4f44-8b1d-b5d1178d8495 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:46.710885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d792b4-5370-4f44-8b1d-b5d1178d8495 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:46.711152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d792b4-5370-4f44-8b1d-b5d1178d8495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:46.723735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:46.778898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d792b4-5370-4f44-8b1d-b5d1178d8495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:46.780627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d792b4-5370-4f44-8b1d-b5d1178d8495 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:46.883625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 525/1051] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 11:05:46.889327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbe90e-a6f6-4bff-b0c0-d2694f66b83a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:46.988999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbe90e-a6f6-4bff-b0c0-d2694f66b83a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:47.023474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8baff-378a-4f33-8c51-9dc6aead19ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:47.024105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8baff-378a-4f33-8c51-9dc6aead19ce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:47.024413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8baff-378a-4f33-8c51-9dc6aead19ce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:47.024681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8baff-378a-4f33-8c51-9dc6aead19ce None admin] PATH_INFO: `/v3/projects/0539671446ba4bf4af8e055877cddb4d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:47.025768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8baff-378a-4f33-8c51-9dc6aead19ce None admin] RBAC: Authorizing `identity:get_project(project_id=0539671446ba4bf4af8e055877cddb4d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:47.027168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8baff-378a-4f33-8c51-9dc6aead19ce None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:47.028950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 527/1052] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:05:46 2022] GET /identity/v3/projects/0539671446ba4bf4af8e055877cddb4d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:47.035191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d792b4-5370-4f44-8b1d-b5d1178d8495 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:47.076934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:47.134779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d792b4-5370-4f44-8b1d-b5d1178d8495 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:47.145934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a016376-e993-495b-8a62-0fa929e843c2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:47.146208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a016376-e993-495b-8a62-0fa929e843c2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:47.146479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a016376-e993-495b-8a62-0fa929e843c2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:47.147952 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 528/1053] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:47.152742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7db5ac-f968-45af-9d24-e76c2afe8394 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:47.153028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7db5ac-f968-45af-9d24-e76c2afe8394 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:47.153302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7db5ac-f968-45af-9d24-e76c2afe8394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:47.169941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:47.170545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:47.170833 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:47.171090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:47.171806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=0539671446ba4bf4af8e055877cddb4d, user.id=b1a6428f0bbe45eda5167cea7692aca7) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:47.172115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:47.172226 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-af7db5ac-f968-45af-9d24-e76c2afe8394 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:47.173379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-af7db5ac-f968-45af-9d24-e76c2afe8394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:47.173559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:47.182145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 526/1054] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:47 2022] GET /identity/v3/role_assignments?user.id=b1a6428f0bbe45eda5167cea7692aca7&scope.project.id=0539671446ba4bf4af8e055877cddb4d&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:47.204598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:47.251317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 529/1055] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:47.274461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:47.382494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e40d9-e0d9-4ddd-aad1-64fcc65982a0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:47.385066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:47.418518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:47.419181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:47.419556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:47.419677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] PATH_INFO: `/v3/services/image` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:47.420245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:47.421633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:47.431245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:47.432276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 11:05:47.433191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:47.437430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 527/1056] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 10 11:05:47 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:47.438407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7db5ac-f968-45af-9d24-e76c2afe8394 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:47.538846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7db5ac-f968-45af-9d24-e76c2afe8394 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:47.572326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:47.572938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:47.573263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:47.573548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:47.574179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:47.574481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:47.575835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:47.585972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 530/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:47.587150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:47.690299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddef30-0068-4715-b412-77ff54aa968e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:47.724036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50eb2f-b9b0-4c25-8f67-f14c2cba5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:47.724715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50eb2f-b9b0-4c25-8f67-f14c2cba5314 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:47.724977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50eb2f-b9b0-4c25-8f67-f14c2cba5314 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:47.725248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50eb2f-b9b0-4c25-8f67-f14c2cba5314 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:47.725900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50eb2f-b9b0-4c25-8f67-f14c2cba5314 None admin] RBAC: Adding query filter params (type=image) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:47.726195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50eb2f-b9b0-4c25-8f67-f14c2cba5314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:47.727550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50eb2f-b9b0-4c25-8f67-f14c2cba5314 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:47.732494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 528/1058] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:47.737980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:47.767906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:47.850042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60b802-e1d1-488f-90b8-a476d25031f8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:47.883504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae0058-2fca-418e-8245-daa93a40c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:47.884109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0058-2fca-418e-8245-daa93a40c635 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:47.884474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0058-2fca-418e-8245-daa93a40c635 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:47.884749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae0058-2fca-418e-8245-daa93a40c635 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:47.885414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae0058-2fca-418e-8245-daa93a40c635 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:47.886758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae0058-2fca-418e-8245-daa93a40c635 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:47.945240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 531/1059] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:05:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:05:48.242282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b45f8d-10ec-412b-87eb-50e6a4a988b3 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:48.242674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b45f8d-10ec-412b-87eb-50e6a4a988b3 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:48.242853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b45f8d-10ec-412b-87eb-50e6a4a988b3 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:48.244345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 529/1060] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:48.249314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560a7c-6db7-4aab-a745-f2e5b7f63d3c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:48.249603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560a7c-6db7-4aab-a745-f2e5b7f63d3c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:48.249878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60560a7c-6db7-4aab-a745-f2e5b7f63d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:48.268420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-60560a7c-6db7-4aab-a745-f2e5b7f63d3c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:48.269651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-60560a7c-6db7-4aab-a745-f2e5b7f63d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:48.346151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 532/1061] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:48.368958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b45f8d-10ec-412b-87eb-50e6a4a988b3 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:48.401305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:48.473588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b45f8d-10ec-412b-87eb-50e6a4a988b3 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:48.508203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85200-d3a4-4017-9c49-696dc38f9266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:48.508786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85200-d3a4-4017-9c49-696dc38f9266 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:48.509067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85200-d3a4-4017-9c49-696dc38f9266 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:48.509338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85200-d3a4-4017-9c49-696dc38f9266 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:48.519230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd85200-d3a4-4017-9c49-696dc38f9266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-bcd85200-d3a4-4017-9c49-696dc38f9266 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:48.524604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:48.525537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:48.526373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:48.528621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 530/1062] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 11:05:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:48.531884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60560a7c-6db7-4aab-a745-f2e5b7f63d3c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:48.544092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:48.630956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60560a7c-6db7-4aab-a745-f2e5b7f63d3c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:48.665980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:48.666598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:48.666880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:48.667150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:48.667817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:48.668123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:48.669508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:48.677993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 533/1063] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 11:05:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:48.683682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85200-d3a4-4017-9c49-696dc38f9266 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:48.775886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:48.785246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85200-d3a4-4017-9c49-696dc38f9266 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:48.827418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a4258-8443-4136-965b-8bee9208304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:48.828082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4258-8443-4136-965b-8bee9208304c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:48.828390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4258-8443-4136-965b-8bee9208304c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:48.828665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4258-8443-4136-965b-8bee9208304c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:48.839676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a4258-8443-4136-965b-8bee9208304c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:48.841156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a4258-8443-4136-965b-8bee9208304c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-349a4258-8443-4136-965b-8bee9208304c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:48.855505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:48.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:48.857708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:48.857708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:48.857708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:48.860615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 531/1064] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:48.862248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:48.935112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:48.965329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3a57e-f9ae-41c0-bd51-08797025e19c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.000293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d938f78-6b9a-4271-a096-8536f05b99d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.000923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938f78-6b9a-4271-a096-8536f05b99d7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.001201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938f78-6b9a-4271-a096-8536f05b99d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.001470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938f78-6b9a-4271-a096-8536f05b99d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.002108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d938f78-6b9a-4271-a096-8536f05b99d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:49.002406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d938f78-6b9a-4271-a096-8536f05b99d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.003756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d938f78-6b9a-4271-a096-8536f05b99d7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.020012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 534/1065] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:49.021217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a4258-8443-4136-965b-8bee9208304c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.127281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a4258-8443-4136-965b-8bee9208304c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.162378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.163062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.163345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.163615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.171273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.172730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:49.184252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:49.185262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:49.191072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 532/1066] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:49.192390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63a79-39da-4551-b0ce-6a0c5b0c094e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.192390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63a79-39da-4551-b0ce-6a0c5b0c094e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.192390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63a79-39da-4551-b0ce-6a0c5b0c094e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.192390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 535/1067] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:05:49.192645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.195033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:49.197176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833f0f-3438-4a6a-b7e2-3a564c4bb647 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.197564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833f0f-3438-4a6a-b7e2-3a564c4bb647 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.197929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833f0f-3438-4a6a-b7e2-3a564c4bb647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.217061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-aa833f0f-3438-4a6a-b7e2-3a564c4bb647 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:49.218357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-aa833f0f-3438-4a6a-b7e2-3a564c4bb647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:49.292286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 536/1068] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:49.293198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ef3c-a540-437b-8c5f-e2b61b15ee95 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.314670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa833f0f-3438-4a6a-b7e2-3a564c4bb647 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.331764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.332830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.333243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.333525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.334252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:49.334556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.335973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.353728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 533/1069] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:49.359089 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.390019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:49.424681 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:49.439517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa833f0f-3438-4a6a-b7e2-3a564c4bb647 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.466269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2b94e-d719-4eb9-8708-16913f5b5634 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.476229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26737dc7-668f-49ad-89f8-0af6024d229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.476905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26737dc7-668f-49ad-89f8-0af6024d229e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.477188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26737dc7-668f-49ad-89f8-0af6024d229e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.477461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26737dc7-668f-49ad-89f8-0af6024d229e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.488565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26737dc7-668f-49ad-89f8-0af6024d229e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-26737dc7-668f-49ad-89f8-0af6024d229e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:49.493719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:49.494662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:49.495525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 537/1070] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:49.500810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26737dc7-668f-49ad-89f8-0af6024d229e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.505580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.506219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.506499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.506768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.517463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.518935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:49.533654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:49.534649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:49.540905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:49.540905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:49.540905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:49.540905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 534/1071] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:49.541686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.612720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26737dc7-668f-49ad-89f8-0af6024d229e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.638310 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:49.646406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102c63-a909-4525-b94f-70610ffc83ca None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.650845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.651464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.655705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.655705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.655705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:49.655705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.655705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.663718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 538/1072] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:49.664837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:49.669472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.685446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.686053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.686329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.686597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.687236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:49.687536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.688924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.700787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 535/1073] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:49.706210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.787022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1b308-adf3-41a4-b402-9989efa8c06e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.816623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadf6c8-60ea-4814-83a1-1f67983dcf1e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.830075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aae3b1-49c8-4a39-82c2-6ce65bf4ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.830718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aae3b1-49c8-4a39-82c2-6ce65bf4ac50 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.830995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aae3b1-49c8-4a39-82c2-6ce65bf4ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.831263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aae3b1-49c8-4a39-82c2-6ce65bf4ac50 None admin] PATH_INFO: `/v3/users/b1a6428f0bbe45eda5167cea7692aca7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.833164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aae3b1-49c8-4a39-82c2-6ce65bf4ac50 None admin] RBAC: Authorizing `identity:get_user(user_id=b1a6428f0bbe45eda5167cea7692aca7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.834766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aae3b1-49c8-4a39-82c2-6ce65bf4ac50 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.836357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 539/1074] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/users/b1a6428f0bbe45eda5167cea7692aca7 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:49.841847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aae3b1-49c8-4a39-82c2-6ce65bf4ac50 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.856621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.857257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.857533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.857804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.865108 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.866535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:49.877377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:49.878458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:49.879597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:49.879597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:49.879597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:49.879597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:49.879597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:49.879597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:49.879597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:49.879597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:49.883350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 536/1075] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:49.884156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:49.904939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:49.918380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:49.952558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aae3b1-49c8-4a39-82c2-6ce65bf4ac50 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.987944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22652a3c-9670-4caf-932e-5deed6155ef6 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:49.988824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3ce28-977b-48a0-927b-09d8878e6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:49.989441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ce28-977b-48a0-927b-09d8878e6a20 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.989717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ce28-977b-48a0-927b-09d8878e6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.989987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ce28-977b-48a0-927b-09d8878e6a20 None admin] PATH_INFO: `/v3/projects/0539671446ba4bf4af8e055877cddb4d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.991107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3ce28-977b-48a0-927b-09d8878e6a20 None admin] RBAC: Authorizing `identity:get_project(project_id=0539671446ba4bf4af8e055877cddb4d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:49.992560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3ce28-977b-48a0-927b-09d8878e6a20 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:49.994186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 540/1076] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/projects/0539671446ba4bf4af8e055877cddb4d => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:49.995319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7ac4-6cf9-4a07-acaa-e97b0d9da86f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:49.995603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7ac4-6cf9-4a07-acaa-e97b0d9da86f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:49.995879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d7ac4-6cf9-4a07-acaa-e97b0d9da86f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:49.997199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 541/1077] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:50.000132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d7ac4-6cf9-4a07-acaa-e97b0d9da86f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:50.023985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9004e8-49b1-4f98-9d52-1f3497f7c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:50.024622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9004e8-49b1-4f98-9d52-1f3497f7c176 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:50.024902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9004e8-49b1-4f98-9d52-1f3497f7c176 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:50.025173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9004e8-49b1-4f98-9d52-1f3497f7c176 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:50.025865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9004e8-49b1-4f98-9d52-1f3497f7c176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:50.026175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9004e8-49b1-4f98-9d52-1f3497f7c176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:50.027611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9004e8-49b1-4f98-9d52-1f3497f7c176 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:50.039290 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 537/1078] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:50.040469 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fa5b4-7bfe-484f-b42b-4aa56ed14073 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:50.040754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fa5b4-7bfe-484f-b42b-4aa56ed14073 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:50.041029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fa5b4-7bfe-484f-b42b-4aa56ed14073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:50.058650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-276fa5b4-7bfe-484f-b42b-4aa56ed14073 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:50.059822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-276fa5b4-7bfe-484f-b42b-4aa56ed14073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:50.100332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d7ac4-6cf9-4a07-acaa-e97b0d9da86f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:50.119752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:50.126166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 538/1079] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:50.126986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fa5b4-7bfe-484f-b42b-4aa56ed14073 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:50.135238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad4d8-6594-4275-9905-676921f21370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:50.135238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad4d8-6594-4275-9905-676921f21370 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:50.135238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad4d8-6594-4275-9905-676921f21370 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:50.135238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad4d8-6594-4275-9905-676921f21370 None admin] PATH_INFO: `/v3/projects/0539671446ba4bf4af8e055877cddb4d/users/b1a6428f0bbe45eda5167cea7692aca7/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:50.137125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ad4d8-6594-4275-9905-676921f21370 None admin] RBAC: Authorizing `identity:create_grant(project_id=0539671446ba4bf4af8e055877cddb4d, user_id=b1a6428f0bbe45eda5167cea7692aca7, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:50.138536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ad4d8-6594-4275-9905-676921f21370 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:50.155200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:50.211817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 542/1080] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:05:49 2022] PUT /identity/v3/projects/0539671446ba4bf4af8e055877cddb4d/users/b1a6428f0bbe45eda5167cea7692aca7/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:05:50.212732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad4d8-6594-4275-9905-676921f21370 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:50.229813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fa5b4-7bfe-484f-b42b-4aa56ed14073 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:50.267706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfd4b4-a474-4a8a-b7f5-f3208baacbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:50.268424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfd4b4-a474-4a8a-b7f5-f3208baacbcd None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:50.268707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfd4b4-a474-4a8a-b7f5-f3208baacbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:50.268988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfd4b4-a474-4a8a-b7f5-f3208baacbcd None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/e64f4c342e714597b6c628ca022d7b9a/roles/cc7f11a1b669499daed397d417c3111b` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:50.271348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfd4b4-a474-4a8a-b7f5-f3208baacbcd None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=e64f4c342e714597b6c628ca022d7b9a, role_id=cc7f11a1b669499daed397d417c3111b)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:50.272868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfd4b4-a474-4a8a-b7f5-f3208baacbcd None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:50.339233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad4d8-6594-4275-9905-676921f21370 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:50.360337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 539/1081] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:05:50 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/e64f4c342e714597b6c628ca022d7b9a/roles/cc7f11a1b669499daed397d417c3111b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:05:50.391914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6302f-62d5-4166-9be7-b56d45215923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:50.392582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6302f-62d5-4166-9be7-b56d45215923 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:50.392861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6302f-62d5-4166-9be7-b56d45215923 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:50.393130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6302f-62d5-4166-9be7-b56d45215923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:50.450224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:50.470859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6302f-62d5-4166-9be7-b56d45215923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:50.472347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6302f-62d5-4166-9be7-b56d45215923 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:50.578845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 543/1082] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:50.585333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfd4b4-a474-4a8a-b7f5-f3208baacbcd None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:50.672766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:50.689788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfd4b4-a474-4a8a-b7f5-f3208baacbcd None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:50.727851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d33e7-da66-4ec4-9ed9-1c92f78ff2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:50.728877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d33e7-da66-4ec4-9ed9-1c92f78ff2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:50.729380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d33e7-da66-4ec4-9ed9-1c92f78ff2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:50.729854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d33e7-da66-4ec4-9ed9-1c92f78ff2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:50.740286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d33e7-da66-4ec4-9ed9-1c92f78ff2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:50.742031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d33e7-da66-4ec4-9ed9-1c92f78ff2d6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-a53d33e7-da66-4ec4-9ed9-1c92f78ff2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:50.756614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:50.757594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:50.758504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:50.758504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:50.758504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:50.765289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 540/1083] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:50.766426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6302f-62d5-4166-9be7-b56d45215923 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:50.857585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:50.875754 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6302f-62d5-4166-9be7-b56d45215923 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:50.909845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90686d91-b723-46f5-adf5-78704d25b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:50.911074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90686d91-b723-46f5-adf5-78704d25b462 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:50.911419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90686d91-b723-46f5-adf5-78704d25b462 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:50.911704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90686d91-b723-46f5-adf5-78704d25b462 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:50.912357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90686d91-b723-46f5-adf5-78704d25b462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:50.912657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90686d91-b723-46f5-adf5-78704d25b462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:50.913997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90686d91-b723-46f5-adf5-78704d25b462 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:50.932355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 544/1084] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:52.263259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb900-030d-46de-b118-07d143aea386 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.263789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb900-030d-46de-b118-07d143aea386 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.263789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fb900-030d-46de-b118-07d143aea386 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.265149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 541/1085] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:52.271055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a6a9b-fbad-4b62-aff3-82710742d4e2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.271448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a6a9b-fbad-4b62-aff3-82710742d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.271611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a6a9b-fbad-4b62-aff3-82710742d4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.290162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c93a6a9b-fbad-4b62-aff3-82710742d4e2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:52.291327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c93a6a9b-fbad-4b62-aff3-82710742d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:52.355938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 545/1086] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:52.367158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20359-87bd-4750-9949-b8de2aea4a6a None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.367448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20359-87bd-4750-9949-b8de2aea4a6a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.367726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d20359-87bd-4750-9949-b8de2aea4a6a None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.369121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 542/1087] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:52.374237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4664-b7fa-44ed-b3e0-32d422a5cad0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.374520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4664-b7fa-44ed-b3e0-32d422a5cad0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.374793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4664-b7fa-44ed-b3e0-32d422a5cad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.378961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d20359-87bd-4750-9949-b8de2aea4a6a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:52.392981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0dae4664-b7fa-44ed-b3e0-32d422a5cad0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:52.394151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0dae4664-b7fa-44ed-b3e0-32d422a5cad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:52.456374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:52.461266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 546/1088] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:52.484519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4664-b7fa-44ed-b3e0-32d422a5cad0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:52.486308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d20359-87bd-4750-9949-b8de2aea4a6a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:52.520527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d397e9-1f42-442a-8d7b-4018a38842ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:52.520974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d397e9-1f42-442a-8d7b-4018a38842ef None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.521254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d397e9-1f42-442a-8d7b-4018a38842ef None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.521529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d397e9-1f42-442a-8d7b-4018a38842ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.524071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:52.531901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d397e9-1f42-442a-8d7b-4018a38842ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-42d397e9-1f42-442a-8d7b-4018a38842ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:52.537588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:52.538568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:05:52.539422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 543/1089] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:05:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:52.544092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d397e9-1f42-442a-8d7b-4018a38842ef None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:52.586788 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4664-b7fa-44ed-b3e0-32d422a5cad0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:52.621381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c549dd-6bff-434a-bd35-1d0f6c86ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:52.622015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c549dd-6bff-434a-bd35-1d0f6c86ef72 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.622294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c549dd-6bff-434a-bd35-1d0f6c86ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.622565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c549dd-6bff-434a-bd35-1d0f6c86ef72 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.632398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c549dd-6bff-434a-bd35-1d0f6c86ef72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d5c549dd-6bff-434a-bd35-1d0f6c86ef72 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:05:52.637029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:52.638013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:52.638901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 547/1090] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 10 11:05:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:52.643842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d397e9-1f42-442a-8d7b-4018a38842ef None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:52.643983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c549dd-6bff-434a-bd35-1d0f6c86ef72 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:52.680421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:52.681025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.681304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.681576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.682239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:52.682539 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:52.683960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:52.692207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 544/1091] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:05:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:52.698007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:52.702230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:52.743468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c549dd-6bff-434a-bd35-1d0f6c86ef72 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:52.755783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:52.777756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:52.778300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.778580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.778852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.779765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:52.780065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:52.781450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:52.789985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 548/1092] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 11:05:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:52.795596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:52.798801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2a112-9477-408d-90fb-1edbdabb7002 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:52.834690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5c93-f0d7-4067-98e3-61f038c9ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:52.835326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5c93-f0d7-4067-98e3-61f038c9ba23 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.835603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5c93-f0d7-4067-98e3-61f038c9ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.835871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e5c93-f0d7-4067-98e3-61f038c9ba23 None admin] PATH_INFO: `/v3/users/b1a6428f0bbe45eda5167cea7692aca7` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.837434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e5c93-f0d7-4067-98e3-61f038c9ba23 None admin] RBAC: Authorizing `identity:get_user(user_id=b1a6428f0bbe45eda5167cea7692aca7)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:52.839242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e5c93-f0d7-4067-98e3-61f038c9ba23 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:52.841270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 545/1093] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:05:52 2022] GET /identity/v3/users/b1a6428f0bbe45eda5167cea7692aca7 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:52.847179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5c93-f0d7-4067-98e3-61f038c9ba23 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:52.898555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f3dbc-67bd-4b2a-92c4-ba8808e078c7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:52.920430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:52.931851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:52.932574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.932852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.933120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:52.943830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:52.945229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e5c93-f0d7-4067-98e3-61f038c9ba23 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:52.945339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:52.960080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:52.961035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:52.961938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:52.961938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:52.961938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:52.961938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 549/1094] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:52.966920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:52.970587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:52.979633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd2a2-d01d-43f0-b42b-8228d14bca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:52.980240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd2a2-d01d-43f0-b42b-8228d14bca04 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:52.980564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd2a2-d01d-43f0-b42b-8228d14bca04 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:52.980831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd2a2-d01d-43f0-b42b-8228d14bca04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:53.047417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd2a2-d01d-43f0-b42b-8228d14bca04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:53.048834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd2a2-d01d-43f0-b42b-8228d14bca04 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:53.064029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec8072-e0f0-4ea7-8141-6b08108889d8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:53.097136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:53.098286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:53.098560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:53.098829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:53.099470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:53.099767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:53.101142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:53.112623 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 550/1095] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:53.118493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:53.145307 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 546/1096] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 11:05:53.150988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd2a2-d01d-43f0-b42b-8228d14bca04 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:53.151399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:53.176405 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:53.216610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87216ea5-a1b6-457f-b843-8a5b29e5aa28 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:53.247622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd2a2-d01d-43f0-b42b-8228d14bca04 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:53.249775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:53.250403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:53.250678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:53.250948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:53.258474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:53.259892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:05:53.271244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:53.273006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:53.274354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 551/1097] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 10 11:05:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:05:53.277904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:53.283724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8a638-cc9e-4b9b-95c3-e0479426203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:53.284378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8a638-cc9e-4b9b-95c3-e0479426203a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:53.284659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8a638-cc9e-4b9b-95c3-e0479426203a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:53.285618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8a638-cc9e-4b9b-95c3-e0479426203a None admin] PATH_INFO: `/v3/projects/0539671446ba4bf4af8e055877cddb4d` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:53.286615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8a638-cc9e-4b9b-95c3-e0479426203a None admin] RBAC: Authorizing `identity:get_project(project_id=0539671446ba4bf4af8e055877cddb4d)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:53.288068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8a638-cc9e-4b9b-95c3-e0479426203a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:53.292245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 547/1098] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:05:53 2022] GET /identity/v3/projects/0539671446ba4bf4af8e055877cddb4d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:53.295693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8a638-cc9e-4b9b-95c3-e0479426203a None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:53.372511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:53.379327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6a9fd-d72c-481b-a608-58ff747a8a67 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:53.391133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:53.397393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8a638-cc9e-4b9b-95c3-e0479426203a None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:53.414681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:53.415295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:53.415582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:53.415855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:53.416642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:53.416945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:53.418366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:53.433377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:53.433975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:53.434252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:53.434520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:53.435238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=0539671446ba4bf4af8e055877cddb4d, user.id=b1a6428f0bbe45eda5167cea7692aca7) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:53.435546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:53.436987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:53.442688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 548/1099] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:53 2022] GET /identity/v3/role_assignments?user.id=b1a6428f0bbe45eda5167cea7692aca7&scope.project.id=0539671446ba4bf4af8e055877cddb4d&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:53.455374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 552/1100] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 10 11:05:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:53.461464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:53.564293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3f98a-218d-44bf-9aaf-a677f1a8a9de None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:53.600815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d388-ddd5-4e8b-83ab-a552da2854a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:53.601426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d388-ddd5-4e8b-83ab-a552da2854a0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:53.601708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d388-ddd5-4e8b-83ab-a552da2854a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:53.601980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d388-ddd5-4e8b-83ab-a552da2854a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:53.629085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:53.670353 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7d388-ddd5-4e8b-83ab-a552da2854a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:53.671795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7d388-ddd5-4e8b-83ab-a552da2854a0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:53.766320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 549/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:53.772523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:53.871570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4551d-575a-470b-8583-90d59e15c4a4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:53.904696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:53.905259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:53.905536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:53.905805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:53.916046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:53.917514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:05:53.931714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:53.932915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:05:53.934184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:05:53.934184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:05:53.934184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:53.934543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 553/1102] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:53.938459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d388-ddd5-4e8b-83ab-a552da2854a0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:53.993871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:54.034683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d388-ddd5-4e8b-83ab-a552da2854a0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:54.066923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:54.067522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:54.067798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:54.068067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:54.068737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:54.069038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:54.070396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:54.082453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 550/1103] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:54.088028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:54.092331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:54.186637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90606f3c-02f1-4ce8-8323-69485fffb83d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:54.220077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:54.220739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:54.221020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:54.221290 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:54.227997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:54.229460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:05:54.240630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:05:54.241684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:05:54.242885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:05:54.242885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:05:54.242885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:05:54.242885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:05:54.242885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:05:54.242885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:05:54.242885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:05:54.242885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:05:54.246474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 554/1104] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:05:54.247463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:54.343064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b00dae-fcd0-4a84-9249-baebce1c7470 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:54.359230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:54.375879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea6446-d21f-45e8-97b0-c1441e361ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:54.376515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6446-d21f-45e8-97b0-c1441e361ccb None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:54.376793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6446-d21f-45e8-97b0-c1441e361ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:54.377062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6446-d21f-45e8-97b0-c1441e361ccb None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:54.377772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea6446-d21f-45e8-97b0-c1441e361ccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:54.378075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea6446-d21f-45e8-97b0-c1441e361ccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:54.380187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea6446-d21f-45e8-97b0-c1441e361ccb None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:54.391614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 551/1105] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:54.397716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:54.488743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:54.526318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a179db1-ffa6-44bb-9750-e3c5e02640e9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:54.559960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a59226-c13d-4ff2-aeb5-e342fd8fe944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:54.560599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a59226-c13d-4ff2-aeb5-e342fd8fe944 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:54.560880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a59226-c13d-4ff2-aeb5-e342fd8fe944 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:54.561152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a59226-c13d-4ff2-aeb5-e342fd8fe944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:54.561876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a59226-c13d-4ff2-aeb5-e342fd8fe944 None admin] RBAC: Adding query filter params (role.id=cc7f11a1b669499daed397d417c3111b, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=e64f4c342e714597b6c628ca022d7b9a) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:54.562180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a59226-c13d-4ff2-aeb5-e342fd8fe944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:54.563599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a59226-c13d-4ff2-aeb5-e342fd8fe944 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:54.570009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 555/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:54 2022] GET /identity/v3/role_assignments?user.id=e64f4c342e714597b6c628ca022d7b9a&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=cc7f11a1b669499daed397d417c3111b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:05:55.482295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ca9c1-0a8b-4633-b7ee-c4daa227da9f None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:55.482856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ca9c1-0a8b-4633-b7ee-c4daa227da9f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:55.482856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ca9c1-0a8b-4633-b7ee-c4daa227da9f None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:55.484153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 552/1107] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:55.490009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef239-6199-4a2d-8ad6-1fd551eba773 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:55.490434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef239-6199-4a2d-8ad6-1fd551eba773 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:55.490544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef239-6199-4a2d-8ad6-1fd551eba773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:55.508125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7a2ef239-6199-4a2d-8ad6-1fd551eba773 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:55.509333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7a2ef239-6199-4a2d-8ad6-1fd551eba773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:55.572966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 556/1108] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:05:55.596665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ca9c1-0a8b-4633-b7ee-c4daa227da9f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:55.694160 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ca9c1-0a8b-4633-b7ee-c4daa227da9f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:55.725852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ab14-d646-4761-bfd8-9df44282acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:55.726456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ab14-d646-4761-bfd8-9df44282acce None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:55.726731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ab14-d646-4761-bfd8-9df44282acce None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:55.726996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ab14-d646-4761-bfd8-9df44282acce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:55.728072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5ab14-d646-4761-bfd8-9df44282acce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:55.729525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5ab14-d646-4761-bfd8-9df44282acce None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:55.731038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 553/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:05:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:55.736765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ef239-6199-4a2d-8ad6-1fd551eba773 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:55.792318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:55.832377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ef239-6199-4a2d-8ad6-1fd551eba773 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:55.866083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae5fd8-033a-48d4-912b-f26b2d1fa1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:55.866679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae5fd8-033a-48d4-912b-f26b2d1fa1e2 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:55.866953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae5fd8-033a-48d4-912b-f26b2d1fa1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:55.867222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae5fd8-033a-48d4-912b-f26b2d1fa1e2 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:55.867864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae5fd8-033a-48d4-912b-f26b2d1fa1e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:55.869308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae5fd8-033a-48d4-912b-f26b2d1fa1e2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:55.954407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 557/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:05:55 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:05:57.979839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcee55e-0ca5-4c12-b278-28a00082d175 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:57.980401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcee55e-0ca5-4c12-b278-28a00082d175 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:57.980401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcee55e-0ca5-4c12-b278-28a00082d175 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:57.981728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 554/1111] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:05:57.986856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181013b-006d-4310-9254-4b3abedc7776 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:57.987236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181013b-006d-4310-9254-4b3abedc7776 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:57.987405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181013b-006d-4310-9254-4b3abedc7776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:58.005952 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e181013b-006d-4310-9254-4b3abedc7776 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:05:58.007126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e181013b-006d-4310-9254-4b3abedc7776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:05:58.071110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 558/1112] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:05:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:05:58.095559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcee55e-0ca5-4c12-b278-28a00082d175 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:58.142073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:58.194933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcee55e-0ca5-4c12-b278-28a00082d175 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:58.227739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dff500-132c-4d23-82de-9a452f1ae4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:58.228375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dff500-132c-4d23-82de-9a452f1ae4df None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:58.228665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dff500-132c-4d23-82de-9a452f1ae4df None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:58.228940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dff500-132c-4d23-82de-9a452f1ae4df None admin] PATH_INFO: `/v3/roles/1b09a9c0489848ada69cb56ccf36aebd` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:58.230313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dff500-132c-4d23-82de-9a452f1ae4df None admin] RBAC: Authorizing `identity:get_role(role_id=1b09a9c0489848ada69cb56ccf36aebd)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:58.231664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dff500-132c-4d23-82de-9a452f1ae4df None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:58.232977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 555/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:05:58 2022] GET /identity/v3/roles/1b09a9c0489848ada69cb56ccf36aebd => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:58.242298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181013b-006d-4310-9254-4b3abedc7776 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:58.287655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:58.340749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181013b-006d-4310-9254-4b3abedc7776 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:58.374331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2836-beb4-4621-8e03-f74ffda4c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:58.374893 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2836-beb4-4621-8e03-f74ffda4c8df None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:58.375175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2836-beb4-4621-8e03-f74ffda4c8df None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:58.375447 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2836-beb4-4621-8e03-f74ffda4c8df None admin] PATH_INFO: `/v3/users/8a11f8bee198482bbf811ab0e2a48d7e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:58.388582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f2836-beb4-4621-8e03-f74ffda4c8df None admin] RBAC: Authorizing `identity:get_user(user_id=8a11f8bee198482bbf811ab0e2a48d7e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:58.390019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f2836-beb4-4621-8e03-f74ffda4c8df None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:58.391632 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 559/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:05:58 2022] GET /identity/v3/users/8a11f8bee198482bbf811ab0e2a48d7e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:58.398036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dff500-132c-4d23-82de-9a452f1ae4df None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:58.495217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dff500-132c-4d23-82de-9a452f1ae4df None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:58.509214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:58.530356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43050b5-f011-4999-a748-c550da255279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:58.531009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43050b5-f011-4999-a748-c550da255279 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:58.531264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43050b5-f011-4999-a748-c550da255279 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:58.531531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43050b5-f011-4999-a748-c550da255279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:58.595313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43050b5-f011-4999-a748-c550da255279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:58.596839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43050b5-f011-4999-a748-c550da255279 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:58.696270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 556/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:05:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:05:58.702234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2836-beb4-4621-8e03-f74ffda4c8df None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:58.805586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2836-beb4-4621-8e03-f74ffda4c8df None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:58.807061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:58.838872 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce07a4-09ed-4a7d-a0b6-419d76cca3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:58.839506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce07a4-09ed-4a7d-a0b6-419d76cca3ba None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:58.839785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce07a4-09ed-4a7d-a0b6-419d76cca3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:58.840060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce07a4-09ed-4a7d-a0b6-419d76cca3ba None admin] PATH_INFO: `/v3/projects/0539671446ba4bf4af8e055877cddb4d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:58.841201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce07a4-09ed-4a7d-a0b6-419d76cca3ba None admin] RBAC: Authorizing `identity:get_project(project_id=0539671446ba4bf4af8e055877cddb4d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:58.842614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce07a4-09ed-4a7d-a0b6-419d76cca3ba None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:58.844215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 560/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:05:58 2022] GET /identity/v3/projects/0539671446ba4bf4af8e055877cddb4d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:05:58.851066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43050b5-f011-4999-a748-c550da255279 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:05:58.865543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:05:58.946882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43050b5-f011-4999-a748-c550da255279 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:05:58.980126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646b63a-a3d9-4a79-b0a5-40ed085a93fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:05:58.980760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646b63a-a3d9-4a79-b0a5-40ed085a93fc None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:05:58.981039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646b63a-a3d9-4a79-b0a5-40ed085a93fc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:05:58.981309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646b63a-a3d9-4a79-b0a5-40ed085a93fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:05:58.982028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646b63a-a3d9-4a79-b0a5-40ed085a93fc None admin] RBAC: Adding query filter params (role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=0539671446ba4bf4af8e055877cddb4d, user.id=8a11f8bee198482bbf811ab0e2a48d7e) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:05:58.982332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646b63a-a3d9-4a79-b0a5-40ed085a93fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:05:58.983743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646b63a-a3d9-4a79-b0a5-40ed085a93fc None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:05:58.989003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 557/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:05:58 2022] GET /identity/v3/role_assignments?user.id=8a11f8bee198482bbf811ab0e2a48d7e&scope.project.id=0539671446ba4bf4af8e055877cddb4d&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:00.953269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630e82d-7571-432e-a4d2-629473e03828 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:00.953790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630e82d-7571-432e-a4d2-629473e03828 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:00.953884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630e82d-7571-432e-a4d2-629473e03828 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:00.955175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 561/1118] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:00.960879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd0fea-eff0-4f3e-933c-d780d6e29fe7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:00.961254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd0fea-eff0-4f3e-933c-d780d6e29fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:00.961431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd0fea-eff0-4f3e-933c-d780d6e29fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:00.979618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-04dd0fea-eff0-4f3e-933c-d780d6e29fe7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:00.980847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-04dd0fea-eff0-4f3e-933c-d780d6e29fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:01.044557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 558/1119] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:01.067568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630e82d-7571-432e-a4d2-629473e03828 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:01.163508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630e82d-7571-432e-a4d2-629473e03828 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:01.195747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194699b-c2a5-4e7e-b46f-a610c3f457af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:01.196372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194699b-c2a5-4e7e-b46f-a610c3f457af None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:01.196651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194699b-c2a5-4e7e-b46f-a610c3f457af None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:01.196921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194699b-c2a5-4e7e-b46f-a610c3f457af None admin] PATH_INFO: `/v3/roles/1b09a9c0489848ada69cb56ccf36aebd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:01.198278 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194699b-c2a5-4e7e-b46f-a610c3f457af None admin] RBAC: Authorizing `identity:get_role(role_id=1b09a9c0489848ada69cb56ccf36aebd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:01.199617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194699b-c2a5-4e7e-b46f-a610c3f457af None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:01.200906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 562/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:01 2022] GET /identity/v3/roles/1b09a9c0489848ada69cb56ccf36aebd => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:01.206727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd0fea-eff0-4f3e-933c-d780d6e29fe7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:01.216420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:01.300760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd0fea-eff0-4f3e-933c-d780d6e29fe7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:01.332755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8c61-c9a9-448c-997f-620e7a10fc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:01.333365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8c61-c9a9-448c-997f-620e7a10fc6c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:01.333643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8c61-c9a9-448c-997f-620e7a10fc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:01.333912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8c61-c9a9-448c-997f-620e7a10fc6c None admin] PATH_INFO: `/v3/users/8a11f8bee198482bbf811ab0e2a48d7e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:01.335007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8c61-c9a9-448c-997f-620e7a10fc6c None admin] RBAC: Authorizing `identity:get_user(user_id=8a11f8bee198482bbf811ab0e2a48d7e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:01.336444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8c61-c9a9-448c-997f-620e7a10fc6c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:01.337975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 559/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:01 2022] GET /identity/v3/users/8a11f8bee198482bbf811ab0e2a48d7e => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:01.343551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194699b-c2a5-4e7e-b46f-a610c3f457af None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:01.382015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:01.438781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194699b-c2a5-4e7e-b46f-a610c3f457af None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:01.471018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b258b6-e5de-4dbc-a5c0-f825749952e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:01.471626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b258b6-e5de-4dbc-a5c0-f825749952e8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:01.471953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b258b6-e5de-4dbc-a5c0-f825749952e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:01.472218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b258b6-e5de-4dbc-a5c0-f825749952e8 None admin] PATH_INFO: `/v3/projects/0539671446ba4bf4af8e055877cddb4d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:01.473344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b258b6-e5de-4dbc-a5c0-f825749952e8 None admin] RBAC: Authorizing `identity:get_project(project_id=0539671446ba4bf4af8e055877cddb4d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:01.474740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b258b6-e5de-4dbc-a5c0-f825749952e8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:01.476507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 563/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:06:01 2022] GET /identity/v3/projects/0539671446ba4bf4af8e055877cddb4d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:01.482173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8c61-c9a9-448c-997f-620e7a10fc6c None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:01.556998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:01.579086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8c61-c9a9-448c-997f-620e7a10fc6c None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:01.611389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d75f2-8355-4589-9438-f0e9320bba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:01.612033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d75f2-8355-4589-9438-f0e9320bba1c None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:01.612358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d75f2-8355-4589-9438-f0e9320bba1c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:01.612637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d75f2-8355-4589-9438-f0e9320bba1c None admin] PATH_INFO: `/v3/projects/0539671446ba4bf4af8e055877cddb4d/users/8a11f8bee198482bbf811ab0e2a48d7e/roles/1b09a9c0489848ada69cb56ccf36aebd` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:01.614909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d75f2-8355-4589-9438-f0e9320bba1c None admin] RBAC: Authorizing `identity:create_grant(project_id=0539671446ba4bf4af8e055877cddb4d, user_id=8a11f8bee198482bbf811ab0e2a48d7e, role_id=1b09a9c0489848ada69cb56ccf36aebd)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:01.616352 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d75f2-8355-4589-9438-f0e9320bba1c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:01.679505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 560/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:06:01 2022] PUT /identity/v3/projects/0539671446ba4bf4af8e055877cddb4d/users/8a11f8bee198482bbf811ab0e2a48d7e/roles/1b09a9c0489848ada69cb56ccf36aebd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:06:03.663676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6474-9da3-45cc-8a83-ac8492d836b9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:03.664213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6474-9da3-45cc-8a83-ac8492d836b9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:03.664213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6474-9da3-45cc-8a83-ac8492d836b9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:03.665559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 564/1124] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:03.670704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85da7b-5b48-47cf-8e5b-a847c4a0e20b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:03.671128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85da7b-5b48-47cf-8e5b-a847c4a0e20b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:03.671258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85da7b-5b48-47cf-8e5b-a847c4a0e20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:03.688712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8e85da7b-5b48-47cf-8e5b-a847c4a0e20b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:03.689880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8e85da7b-5b48-47cf-8e5b-a847c4a0e20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:03.755671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 561/1125] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:06:03.779407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b6474-9da3-45cc-8a83-ac8492d836b9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:03.878801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b6474-9da3-45cc-8a83-ac8492d836b9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:03.884739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:03.910668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8495940-df8d-4675-9efc-5cf6b754a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:03.911286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8495940-df8d-4675-9efc-5cf6b754a39f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:03.911563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8495940-df8d-4675-9efc-5cf6b754a39f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:03.911834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8495940-df8d-4675-9efc-5cf6b754a39f None admin] PATH_INFO: `/v3/roles/1b09a9c0489848ada69cb56ccf36aebd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:03.913223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8495940-df8d-4675-9efc-5cf6b754a39f None admin] RBAC: Authorizing `identity:get_role(role_id=1b09a9c0489848ada69cb56ccf36aebd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:03.914618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8495940-df8d-4675-9efc-5cf6b754a39f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:03.915863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 565/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:03 2022] GET /identity/v3/roles/1b09a9c0489848ada69cb56ccf36aebd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:03.921786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85da7b-5b48-47cf-8e5b-a847c4a0e20b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:03.983062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:04.015659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85da7b-5b48-47cf-8e5b-a847c4a0e20b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:04.047929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4730b00-9ffa-4518-8245-1a2e598a4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:04.048568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4730b00-9ffa-4518-8245-1a2e598a4ead None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:04.048843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4730b00-9ffa-4518-8245-1a2e598a4ead None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:04.049110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4730b00-9ffa-4518-8245-1a2e598a4ead None admin] PATH_INFO: `/v3/users/8a11f8bee198482bbf811ab0e2a48d7e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:04.050767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4730b00-9ffa-4518-8245-1a2e598a4ead None admin] RBAC: Authorizing `identity:get_user(user_id=8a11f8bee198482bbf811ab0e2a48d7e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:04.052167 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4730b00-9ffa-4518-8245-1a2e598a4ead None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:04.053733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 562/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:03 2022] GET /identity/v3/users/8a11f8bee198482bbf811ab0e2a48d7e => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:04.059540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8495940-df8d-4675-9efc-5cf6b754a39f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:04.155520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8495940-df8d-4675-9efc-5cf6b754a39f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:04.188157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62445e2a-211d-449c-b71a-0e863fee7baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:04.188725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62445e2a-211d-449c-b71a-0e863fee7baa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:04.189026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62445e2a-211d-449c-b71a-0e863fee7baa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:04.189303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62445e2a-211d-449c-b71a-0e863fee7baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:04.229121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:04.253837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62445e2a-211d-449c-b71a-0e863fee7baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:04.255242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62445e2a-211d-449c-b71a-0e863fee7baa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:04.349105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 566/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:06:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:04.355057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4730b00-9ffa-4518-8245-1a2e598a4ead None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:04.448485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4730b00-9ffa-4518-8245-1a2e598a4ead None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:04.480812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ce53-2e93-414a-af13-94bcf4167aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:04.481418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ce53-2e93-414a-af13-94bcf4167aeb None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:04.481690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ce53-2e93-414a-af13-94bcf4167aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:04.481957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ce53-2e93-414a-af13-94bcf4167aeb None admin] PATH_INFO: `/v3/projects/0539671446ba4bf4af8e055877cddb4d` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:04.483032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27ce53-2e93-414a-af13-94bcf4167aeb None admin] RBAC: Authorizing `identity:get_project(project_id=0539671446ba4bf4af8e055877cddb4d)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:04.484465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27ce53-2e93-414a-af13-94bcf4167aeb None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:04.486029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 563/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:06:04 2022] GET /identity/v3/projects/0539671446ba4bf4af8e055877cddb4d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:04.492178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62445e2a-211d-449c-b71a-0e863fee7baa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:04.563871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:04.587647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62445e2a-211d-449c-b71a-0e863fee7baa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:04.620256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcb3b1-8adc-4cc3-9f0a-e869802534b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:04.620884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb3b1-8adc-4cc3-9f0a-e869802534b5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:04.621163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb3b1-8adc-4cc3-9f0a-e869802534b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:04.621441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb3b1-8adc-4cc3-9f0a-e869802534b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:04.622158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcb3b1-8adc-4cc3-9f0a-e869802534b5 None admin] RBAC: Adding query filter params (role.id=1b09a9c0489848ada69cb56ccf36aebd, scope.project.id=0539671446ba4bf4af8e055877cddb4d, user.id=8a11f8bee198482bbf811ab0e2a48d7e) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:04.622462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcb3b1-8adc-4cc3-9f0a-e869802534b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:04.623870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcb3b1-8adc-4cc3-9f0a-e869802534b5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:04.630042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 567/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:06:04 2022] GET /identity/v3/role_assignments?user.id=8a11f8bee198482bbf811ab0e2a48d7e&scope.project.id=0539671446ba4bf4af8e055877cddb4d&role.id=1b09a9c0489848ada69cb56ccf36aebd => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:06.627585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a6ad-8a1b-46b9-a269-d9755e9166e9 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:06.628140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a6ad-8a1b-46b9-a269-d9755e9166e9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:06.628140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7a6ad-8a1b-46b9-a269-d9755e9166e9 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:06.629473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 564/1131] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:06.634509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7e66a-65f6-40cd-a243-6487757d2f99 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:06.634878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7e66a-65f6-40cd-a243-6487757d2f99 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:06.635052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7e66a-65f6-40cd-a243-6487757d2f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:06.653002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1fc7e66a-65f6-40cd-a243-6487757d2f99 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:06.654417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1fc7e66a-65f6-40cd-a243-6487757d2f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:06.718685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 568/1132] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:06.741327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a6ad-8a1b-46b9-a269-d9755e9166e9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:06.744172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:06.840831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7a6ad-8a1b-46b9-a269-d9755e9166e9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:06.872621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8798-e97d-4d8d-a350-5bfbd138999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:06.873234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8798-e97d-4d8d-a350-5bfbd138999a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:06.873529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8798-e97d-4d8d-a350-5bfbd138999a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:06.873790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8798-e97d-4d8d-a350-5bfbd138999a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:06.874867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8798-e97d-4d8d-a350-5bfbd138999a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:06.876266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8798-e97d-4d8d-a350-5bfbd138999a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:06.878382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 565/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:06:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:06.884149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7e66a-65f6-40cd-a243-6487757d2f99 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:06.946850 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:06.978618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7e66a-65f6-40cd-a243-6487757d2f99 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:07.011765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b46db1-59a7-48ae-b4fa-aafccf274cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:07.012390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46db1-59a7-48ae-b4fa-aafccf274cad None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:07.012670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46db1-59a7-48ae-b4fa-aafccf274cad None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:07.012941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46db1-59a7-48ae-b4fa-aafccf274cad None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:07.013575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b46db1-59a7-48ae-b4fa-aafccf274cad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:07.014989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b46db1-59a7-48ae-b4fa-aafccf274cad None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:07.098185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 569/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:06:06 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:06:09.110502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9825-dbcd-43ec-9b9d-925b4ece06e6 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:09.111079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9825-dbcd-43ec-9b9d-925b4ece06e6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:09.111079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9825-dbcd-43ec-9b9d-925b4ece06e6 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:09.112702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 566/1135] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:09.117727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaa444-5ba1-4cfe-adc7-23f0665e0c19 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:09.118174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaa444-5ba1-4cfe-adc7-23f0665e0c19 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:09.118273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaa444-5ba1-4cfe-adc7-23f0665e0c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:09.136261 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2fdaa444-5ba1-4cfe-adc7-23f0665e0c19 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:09.137452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2fdaa444-5ba1-4cfe-adc7-23f0665e0c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:09.200903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 570/1136] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:09.225506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c9825-dbcd-43ec-9b9d-925b4ece06e6 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:09.293420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:09.324034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c9825-dbcd-43ec-9b9d-925b4ece06e6 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:09.355805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3326df8-e5e5-4b05-95a2-6ab60d503ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:09.356446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326df8-e5e5-4b05-95a2-6ab60d503ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:09.356725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326df8-e5e5-4b05-95a2-6ab60d503ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:09.356994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3326df8-e5e5-4b05-95a2-6ab60d503ae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:09.358077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3326df8-e5e5-4b05-95a2-6ab60d503ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:09.359486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3326df8-e5e5-4b05-95a2-6ab60d503ae2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:09.361104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 567/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:06:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:09.367503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaa444-5ba1-4cfe-adc7-23f0665e0c19 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:09.415594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:09.462841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaa444-5ba1-4cfe-adc7-23f0665e0c19 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:09.495400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17671d92-90fb-439e-884c-f28540190b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:09.495992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17671d92-90fb-439e-884c-f28540190b27 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:09.496267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17671d92-90fb-439e-884c-f28540190b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:09.496564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17671d92-90fb-439e-884c-f28540190b27 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:09.497201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17671d92-90fb-439e-884c-f28540190b27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:09.498604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17671d92-90fb-439e-884c-f28540190b27 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:09.593425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 571/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:06:09 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:06:11.613391 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada968a6-1b24-4bbd-8f23-0076a860aa60 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:11.613958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada968a6-1b24-4bbd-8f23-0076a860aa60 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:11.613958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada968a6-1b24-4bbd-8f23-0076a860aa60 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:11.615252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 568/1139] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:11.620467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f331-3ef0-4e66-9ec9-e827fe455c43 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:11.620881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f331-3ef0-4e66-9ec9-e827fe455c43 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:11.621012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f331-3ef0-4e66-9ec9-e827fe455c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:11.638903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0e62f331-3ef0-4e66-9ec9-e827fe455c43 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:11.640064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0e62f331-3ef0-4e66-9ec9-e827fe455c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:11.704751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 572/1140] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:06:11.727605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada968a6-1b24-4bbd-8f23-0076a860aa60 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:11.824300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada968a6-1b24-4bbd-8f23-0076a860aa60 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:11.855910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed102a8-dc63-4685-b33e-091ad7e2ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:11.856557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed102a8-dc63-4685-b33e-091ad7e2ac1e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:11.856833 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed102a8-dc63-4685-b33e-091ad7e2ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:11.857102 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed102a8-dc63-4685-b33e-091ad7e2ac1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:11.864082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:11.867725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed102a8-dc63-4685-b33e-091ad7e2ac1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-9ed102a8-dc63-4685-b33e-091ad7e2ac1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:06:11.872334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:06:11.881945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:06:11.882977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 569/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:06:11.883823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f331-3ef0-4e66-9ec9-e827fe455c43 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:11.914046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:11.975439 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f331-3ef0-4e66-9ec9-e827fe455c43 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:12.007796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:12.008418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:12.008697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:12.008967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:12.009622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:12.009921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:12.011289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:12.019578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 573/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:06:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:12.025278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed102a8-dc63-4685-b33e-091ad7e2ac1e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:12.121064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed102a8-dc63-4685-b33e-091ad7e2ac1e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:12.154237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e947-7571-4583-a5a5-1b2c7c925b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:12.154854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e947-7571-4583-a5a5-1b2c7c925b99 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:12.155133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e947-7571-4583-a5a5-1b2c7c925b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:12.155406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73e947-7571-4583-a5a5-1b2c7c925b99 None admin] PATH_INFO: `/v3/users/15a37fe3903d4bbdba46ad4273259f0e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:12.168465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73e947-7571-4583-a5a5-1b2c7c925b99 None admin] RBAC: Authorizing `identity:get_user(user_id=15a37fe3903d4bbdba46ad4273259f0e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:12.169883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73e947-7571-4583-a5a5-1b2c7c925b99 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:12.171440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 570/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:12 2022] GET /identity/v3/users/15a37fe3903d4bbdba46ad4273259f0e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:12.177375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:12.270326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:12.273774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e9f9-21dd-4abe-982d-b499dc3426f3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:12.305947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff013d2-a36f-4200-9adb-98a2ce6f905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:12.306540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff013d2-a36f-4200-9adb-98a2ce6f905a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:12.306816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff013d2-a36f-4200-9adb-98a2ce6f905a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:12.307082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff013d2-a36f-4200-9adb-98a2ce6f905a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:12.370543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff013d2-a36f-4200-9adb-98a2ce6f905a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:12.371999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff013d2-a36f-4200-9adb-98a2ce6f905a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:12.460635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:12.464912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 574/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:06:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:12.470821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e947-7571-4583-a5a5-1b2c7c925b99 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:12.524663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:12.567463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73e947-7571-4583-a5a5-1b2c7c925b99 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:12.598641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fdea6-4b9a-479e-a108-c7d3d8c8c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:12.599256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fdea6-4b9a-479e-a108-c7d3d8c8c743 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:12.599535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fdea6-4b9a-479e-a108-c7d3d8c8c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:12.599806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fdea6-4b9a-479e-a108-c7d3d8c8c743 None admin] PATH_INFO: `/v3/projects/6038d2442c8f4d84a8050a7f0e363d2f` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:12.600915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fdea6-4b9a-479e-a108-c7d3d8c8c743 None admin] RBAC: Authorizing `identity:get_project(project_id=6038d2442c8f4d84a8050a7f0e363d2f)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:12.602319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fdea6-4b9a-479e-a108-c7d3d8c8c743 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:12.603901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 571/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:06:12 2022] GET /identity/v3/projects/6038d2442c8f4d84a8050a7f0e363d2f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:12.609940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff013d2-a36f-4200-9adb-98a2ce6f905a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:12.705057 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff013d2-a36f-4200-9adb-98a2ce6f905a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:12.737563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0404d2-0ff8-4b2a-9d06-acd100f34b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:12.738144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0404d2-0ff8-4b2a-9d06-acd100f34b53 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:12.738420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0404d2-0ff8-4b2a-9d06-acd100f34b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:12.738689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0404d2-0ff8-4b2a-9d06-acd100f34b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:12.739404 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0404d2-0ff8-4b2a-9d06-acd100f34b53 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=6038d2442c8f4d84a8050a7f0e363d2f, user.id=15a37fe3903d4bbdba46ad4273259f0e) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:12.739704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0404d2-0ff8-4b2a-9d06-acd100f34b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:12.741129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0404d2-0ff8-4b2a-9d06-acd100f34b53 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:12.746210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 575/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:06:12 2022] GET /identity/v3/role_assignments?user.id=15a37fe3903d4bbdba46ad4273259f0e&scope.project.id=6038d2442c8f4d84a8050a7f0e363d2f&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:14.714648 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28562-6cf2-4871-902b-3646b60b09d0 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:14.715186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28562-6cf2-4871-902b-3646b60b09d0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:14.715186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28562-6cf2-4871-902b-3646b60b09d0 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:14.716566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 572/1147] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:14.721823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e427-5fe5-4e32-ba0f-081323e9cddd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:14.722227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e427-5fe5-4e32-ba0f-081323e9cddd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:14.723074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e427-5fe5-4e32-ba0f-081323e9cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:14.740583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fcf3e427-5fe5-4e32-ba0f-081323e9cddd None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:14.741749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fcf3e427-5fe5-4e32-ba0f-081323e9cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:14.796129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:14.805998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 576/1148] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:14.827889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e28562-6cf2-4871-902b-3646b60b09d0 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:14.926402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e28562-6cf2-4871-902b-3646b60b09d0 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:14.949037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:14.959321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb6b8-f3d4-48e1-acf6-8942bf1649dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:14.959937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb6b8-f3d4-48e1-acf6-8942bf1649dc None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:14.960214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb6b8-f3d4-48e1-acf6-8942bf1649dc None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:14.960518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb6b8-f3d4-48e1-acf6-8942bf1649dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:14.970287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbb6b8-f3d4-48e1-acf6-8942bf1649dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-58bbb6b8-f3d4-48e1-acf6-8942bf1649dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:06:14.975835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:06:14.976982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:06:14.978013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 573/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:06:14.982875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3e427-5fe5-4e32-ba0f-081323e9cddd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:15.078178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3e427-5fe5-4e32-ba0f-081323e9cddd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:15.110343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:15.110971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:15.111858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:15.112151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:15.112833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:15.113130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:15.114471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:15.122552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 577/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:15.128435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb6b8-f3d4-48e1-acf6-8942bf1649dc None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:15.224111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb6b8-f3d4-48e1-acf6-8942bf1649dc None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:15.256361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e60a1-7902-4ef1-9131-5b462f1c5d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:15.256973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e60a1-7902-4ef1-9131-5b462f1c5d78 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:15.257251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e60a1-7902-4ef1-9131-5b462f1c5d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:15.257524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e60a1-7902-4ef1-9131-5b462f1c5d78 None admin] PATH_INFO: `/v3/users/15a37fe3903d4bbdba46ad4273259f0e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:15.258624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e60a1-7902-4ef1-9131-5b462f1c5d78 None admin] RBAC: Authorizing `identity:get_user(user_id=15a37fe3903d4bbdba46ad4273259f0e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:15.260039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e60a1-7902-4ef1-9131-5b462f1c5d78 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:15.261604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 574/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:15 2022] GET /identity/v3/users/15a37fe3903d4bbdba46ad4273259f0e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:15.268002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:15.321572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:15.364365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c26e72-e7e7-49f8-95c0-d7ead54ff8c5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:15.396054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c699c5-b1a5-45b4-9b9f-e9d6cbbbfddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:15.396689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c699c5-b1a5-45b4-9b9f-e9d6cbbbfddc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:15.396968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c699c5-b1a5-45b4-9b9f-e9d6cbbbfddc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:15.397236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c699c5-b1a5-45b4-9b9f-e9d6cbbbfddc None admin] PATH_INFO: `/v3/projects/6038d2442c8f4d84a8050a7f0e363d2f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:15.398322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c699c5-b1a5-45b4-9b9f-e9d6cbbbfddc None admin] RBAC: Authorizing `identity:get_project(project_id=6038d2442c8f4d84a8050a7f0e363d2f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:15.399713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c699c5-b1a5-45b4-9b9f-e9d6cbbbfddc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:15.401309 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 578/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:06:15 2022] GET /identity/v3/projects/6038d2442c8f4d84a8050a7f0e363d2f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:15.407409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e60a1-7902-4ef1-9131-5b462f1c5d78 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:15.457841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:15.503357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e60a1-7902-4ef1-9131-5b462f1c5d78 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:15.536349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532748b5-9dbb-4450-a95f-6c879be232a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:15.536990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532748b5-9dbb-4450-a95f-6c879be232a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:15.537265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532748b5-9dbb-4450-a95f-6c879be232a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:15.537534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532748b5-9dbb-4450-a95f-6c879be232a5 None admin] PATH_INFO: `/v3/projects/6038d2442c8f4d84a8050a7f0e363d2f/users/15a37fe3903d4bbdba46ad4273259f0e/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:15.539640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532748b5-9dbb-4450-a95f-6c879be232a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6038d2442c8f4d84a8050a7f0e363d2f, user_id=15a37fe3903d4bbdba46ad4273259f0e, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:15.541095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532748b5-9dbb-4450-a95f-6c879be232a5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:15.615056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 575/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:06:15 2022] PUT /identity/v3/projects/6038d2442c8f4d84a8050a7f0e363d2f/users/15a37fe3903d4bbdba46ad4273259f0e/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:06:17.564231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2c04-1bb5-42a9-ad7c-b43eaf4df843 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:17.564818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2c04-1bb5-42a9-ad7c-b43eaf4df843 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:17.564919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e2c04-1bb5-42a9-ad7c-b43eaf4df843 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:17.566172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 579/1154] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:17.571349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb9fe-93c3-42a4-9225-25696702c973 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:17.571743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb9fe-93c3-42a4-9225-25696702c973 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:17.571900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eb9fe-93c3-42a4-9225-25696702c973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:17.589918 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-bd6eb9fe-93c3-42a4-9225-25696702c973 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:17.591085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-bd6eb9fe-93c3-42a4-9225-25696702c973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:17.656244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 576/1155] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:17.680955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e2c04-1bb5-42a9-ad7c-b43eaf4df843 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:17.780910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e2c04-1bb5-42a9-ad7c-b43eaf4df843 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:17.802691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:17.813685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732d5d2-5c92-4367-bb0b-ea29cade469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:17.819871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d5d2-5c92-4367-bb0b-ea29cade469e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:17.819871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d5d2-5c92-4367-bb0b-ea29cade469e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:17.819871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d5d2-5c92-4367-bb0b-ea29cade469e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:17.825467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732d5d2-5c92-4367-bb0b-ea29cade469e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3732d5d2-5c92-4367-bb0b-ea29cade469e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:06:17.830959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:06:17.832053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:06:17.833111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 580/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:06:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:06:17.838168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eb9fe-93c3-42a4-9225-25696702c973 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:17.879099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:17.933282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eb9fe-93c3-42a4-9225-25696702c973 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:17.966149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:17.966749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:17.967026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:17.967294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:17.967948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:17.968246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:17.969625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:17.977275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 577/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:17.982957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732d5d2-5c92-4367-bb0b-ea29cade469e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:18.079022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732d5d2-5c92-4367-bb0b-ea29cade469e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:18.110377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457d2d-60d7-44e8-933a-b7410e3cc413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:18.111316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457d2d-60d7-44e8-933a-b7410e3cc413 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:18.111647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457d2d-60d7-44e8-933a-b7410e3cc413 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:18.111919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457d2d-60d7-44e8-933a-b7410e3cc413 None admin] PATH_INFO: `/v3/users/15a37fe3903d4bbdba46ad4273259f0e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:18.113038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457d2d-60d7-44e8-933a-b7410e3cc413 None admin] RBAC: Authorizing `identity:get_user(user_id=15a37fe3903d4bbdba46ad4273259f0e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:18.114439 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457d2d-60d7-44e8-933a-b7410e3cc413 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:18.115954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 581/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:17 2022] GET /identity/v3/users/15a37fe3903d4bbdba46ad4273259f0e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:18.121651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:18.217921 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eb3a4-abaa-4814-90de-504b74c865e2 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:18.220139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:18.249811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28ef2-2d52-412f-875c-d31337ca1fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:18.250406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28ef2-2d52-412f-875c-d31337ca1fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:18.250686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28ef2-2d52-412f-875c-d31337ca1fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:18.250956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28ef2-2d52-412f-875c-d31337ca1fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:18.315746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28ef2-2d52-412f-875c-d31337ca1fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:18.317205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28ef2-2d52-412f-875c-d31337ca1fb5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:18.410479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 578/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:06:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:18.416429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457d2d-60d7-44e8-933a-b7410e3cc413 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:18.465369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:18.513407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457d2d-60d7-44e8-933a-b7410e3cc413 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:18.546367 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0eb8b-9d6a-4b05-bffa-b76d2acf6307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:18.546994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0eb8b-9d6a-4b05-bffa-b76d2acf6307 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:18.547274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0eb8b-9d6a-4b05-bffa-b76d2acf6307 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:18.547544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0eb8b-9d6a-4b05-bffa-b76d2acf6307 None admin] PATH_INFO: `/v3/projects/6038d2442c8f4d84a8050a7f0e363d2f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:18.549168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0eb8b-9d6a-4b05-bffa-b76d2acf6307 None admin] RBAC: Authorizing `identity:get_project(project_id=6038d2442c8f4d84a8050a7f0e363d2f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:18.550573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0eb8b-9d6a-4b05-bffa-b76d2acf6307 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:18.552201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 582/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:06:18 2022] GET /identity/v3/projects/6038d2442c8f4d84a8050a7f0e363d2f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:18.558478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28ef2-2d52-412f-875c-d31337ca1fb5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:18.561484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:18.655025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28ef2-2d52-412f-875c-d31337ca1fb5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:18.686620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2ebe4-9ed2-45d7-baf6-13d376934be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:18.687145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2ebe4-9ed2-45d7-baf6-13d376934be6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:18.687423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2ebe4-9ed2-45d7-baf6-13d376934be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:18.687684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2ebe4-9ed2-45d7-baf6-13d376934be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:18.688421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2ebe4-9ed2-45d7-baf6-13d376934be6 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=6038d2442c8f4d84a8050a7f0e363d2f, user.id=15a37fe3903d4bbdba46ad4273259f0e) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:18.688724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2ebe4-9ed2-45d7-baf6-13d376934be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:18.690665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2ebe4-9ed2-45d7-baf6-13d376934be6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:18.696331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 579/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:06:18 2022] GET /identity/v3/role_assignments?user.id=15a37fe3903d4bbdba46ad4273259f0e&scope.project.id=6038d2442c8f4d84a8050a7f0e363d2f&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:20.707207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb1a1-9a27-4166-a3a6-bccb74a22721 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:20.707736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb1a1-9a27-4166-a3a6-bccb74a22721 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:20.707736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeb1a1-9a27-4166-a3a6-bccb74a22721 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:20.709096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 583/1162] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:20.714400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b510f9-61ec-4c59-8f03-6bb9a9faa600 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:20.714793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b510f9-61ec-4c59-8f03-6bb9a9faa600 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:20.714943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b510f9-61ec-4c59-8f03-6bb9a9faa600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:20.732203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f7b510f9-61ec-4c59-8f03-6bb9a9faa600 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:20.733388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f7b510f9-61ec-4c59-8f03-6bb9a9faa600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:20.793120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:20.798885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 580/1163] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:20.822292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeb1a1-9a27-4166-a3a6-bccb74a22721 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:20.919995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeb1a1-9a27-4166-a3a6-bccb74a22721 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:20.936743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:20.952990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4060-7d35-4b16-bbf0-17310a845e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:20.953587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4060-7d35-4b16-bbf0-17310a845e01 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:20.953861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4060-7d35-4b16-bbf0-17310a845e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:20.954130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4060-7d35-4b16-bbf0-17310a845e01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:21.018612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e4060-7d35-4b16-bbf0-17310a845e01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:21.019974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e4060-7d35-4b16-bbf0-17310a845e01 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:21.114244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 584/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:06:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:21.120219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b510f9-61ec-4c59-8f03-6bb9a9faa600 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:21.212712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b510f9-61ec-4c59-8f03-6bb9a9faa600 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:21.245232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25028c4a-5e89-4113-9113-c7a25ebf844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:21.245844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028c4a-5e89-4113-9113-c7a25ebf844c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:21.246118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028c4a-5e89-4113-9113-c7a25ebf844c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:21.246385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028c4a-5e89-4113-9113-c7a25ebf844c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:21.252924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25028c4a-5e89-4113-9113-c7a25ebf844c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:21.254338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25028c4a-5e89-4113-9113-c7a25ebf844c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-25028c4a-5e89-4113-9113-c7a25ebf844c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:06:21.264980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:06:21.266175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:06:21.267374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 581/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:06:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:06:21.272343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4060-7d35-4b16-bbf0-17310a845e01 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:21.290774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:21.368240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e4060-7d35-4b16-bbf0-17310a845e01 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:21.400399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe8b1-c3b7-4c43-b0cd-5e4564e80d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:21.400988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe8b1-c3b7-4c43-b0cd-5e4564e80d23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:21.401265 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe8b1-c3b7-4c43-b0cd-5e4564e80d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:21.401536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe8b1-c3b7-4c43-b0cd-5e4564e80d23 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:21.402171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fe8b1-c3b7-4c43-b0cd-5e4564e80d23 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:21.402470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fe8b1-c3b7-4c43-b0cd-5e4564e80d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:21.404071 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fe8b1-c3b7-4c43-b0cd-5e4564e80d23 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:21.411437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 585/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 10 11:06:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:23.377421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafedf8d-2ce6-44b4-99ad-cf233de2db64 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:23.377958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafedf8d-2ce6-44b4-99ad-cf233de2db64 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:23.377958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafedf8d-2ce6-44b4-99ad-cf233de2db64 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:23.379275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 582/1167] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:23.384481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc1df-8edc-43e2-8bce-068e45c2cfa9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:23.384863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc1df-8edc-43e2-8bce-068e45c2cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:23.385033 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fc1df-8edc-43e2-8bce-068e45c2cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:23.402446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cd2fc1df-8edc-43e2-8bce-068e45c2cfa9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:23.403862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cd2fc1df-8edc-43e2-8bce-068e45c2cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:23.467056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 586/1168] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:23.490356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafedf8d-2ce6-44b4-99ad-cf233de2db64 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:23.550387 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:23.595058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafedf8d-2ce6-44b4-99ad-cf233de2db64 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:23.628254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee7ede-ca19-4bfd-8837-7a1f8f92b55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:23.628834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee7ede-ca19-4bfd-8837-7a1f8f92b55e None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:23.629115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee7ede-ca19-4bfd-8837-7a1f8f92b55e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:23.629406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee7ede-ca19-4bfd-8837-7a1f8f92b55e None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:23.630069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee7ede-ca19-4bfd-8837-7a1f8f92b55e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:23.631418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee7ede-ca19-4bfd-8837-7a1f8f92b55e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:23.696409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 583/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Wed Aug 10 11:06:23 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:06:25.705013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb155ad-1696-47bb-933d-6b4a6b4dac46 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:25.705578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb155ad-1696-47bb-933d-6b4a6b4dac46 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:25.705578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb155ad-1696-47bb-933d-6b4a6b4dac46 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:25.706868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 587/1170] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:25.712033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38dff3-1024-4c24-93ba-13306924c897 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:25.712508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38dff3-1024-4c24-93ba-13306924c897 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:25.712691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38dff3-1024-4c24-93ba-13306924c897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:25.730172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-dd38dff3-1024-4c24-93ba-13306924c897 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:25.731355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-dd38dff3-1024-4c24-93ba-13306924c897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:25.795350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 584/1171] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:25.819143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb155ad-1696-47bb-933d-6b4a6b4dac46 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:25.834085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:25.918341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb155ad-1696-47bb-933d-6b4a6b4dac46 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:25.951370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e294c-7a63-4bf7-829e-953030b91bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:25.951990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e294c-7a63-4bf7-829e-953030b91bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:25.952271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e294c-7a63-4bf7-829e-953030b91bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:25.952570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e294c-7a63-4bf7-829e-953030b91bc3 None admin] PATH_INFO: `/v3/domains/6fb796d6fcc648eb8bafe9fc5b10f820` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:25.962607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e294c-7a63-4bf7-829e-953030b91bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6fb796d6fcc648eb8bafe9fc5b10f820)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:25.963983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e294c-7a63-4bf7-829e-953030b91bc3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:25.965574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 588/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Aug 10 11:06:25 2022] GET /identity/v3/domains/6fb796d6fcc648eb8bafe9fc5b10f820 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:25.971508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38dff3-1024-4c24-93ba-13306924c897 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:26.018234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:26.067882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38dff3-1024-4c24-93ba-13306924c897 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:26.100030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a14a9-0276-4553-a750-7018cd9d55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:26.100671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a14a9-0276-4553-a750-7018cd9d55a2 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:26.100947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a14a9-0276-4553-a750-7018cd9d55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:26.101213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a14a9-0276-4553-a750-7018cd9d55a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:26.101840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a14a9-0276-4553-a750-7018cd9d55a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:26.103243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a14a9-0276-4553-a750-7018cd9d55a2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:26.187613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 585/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:06:25 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:06:28.200856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0c7a-7d08-43ea-90ae-33c19bb28ca7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:28.201397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0c7a-7d08-43ea-90ae-33c19bb28ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:28.201397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0c7a-7d08-43ea-90ae-33c19bb28ca7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:28.202709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 589/1174] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:28.207855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eb61e-08c7-43b4-a3b0-61b223793a5b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:28.208265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eb61e-08c7-43b4-a3b0-61b223793a5b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:28.208428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eb61e-08c7-43b4-a3b0-61b223793a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:28.225728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-7b8eb61e-08c7-43b4-a3b0-61b223793a5b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:28.226883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7b8eb61e-08c7-43b4-a3b0-61b223793a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:28.293192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 586/1175] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:28.316865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a0c7a-7d08-43ea-90ae-33c19bb28ca7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:28.385199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:28.414747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a0c7a-7d08-43ea-90ae-33c19bb28ca7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:28.447906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f1d8c-dc5f-403b-9e53-cb8dadc86ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:28.448552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f1d8c-dc5f-403b-9e53-cb8dadc86ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:28.448831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f1d8c-dc5f-403b-9e53-cb8dadc86ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:28.449099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f1d8c-dc5f-403b-9e53-cb8dadc86ac9 None admin] PATH_INFO: `/v3/domains/6fb796d6fcc648eb8bafe9fc5b10f820` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:28.450185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f1d8c-dc5f-403b-9e53-cb8dadc86ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6fb796d6fcc648eb8bafe9fc5b10f820)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:28.451637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f1d8c-dc5f-403b-9e53-cb8dadc86ac9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:28.453198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 590/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Aug 10 11:06:28 2022] GET /identity/v3/domains/6fb796d6fcc648eb8bafe9fc5b10f820 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:28.459513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8eb61e-08c7-43b4-a3b0-61b223793a5b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:28.487607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:28.555105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8eb61e-08c7-43b4-a3b0-61b223793a5b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:28.587935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0162e-cb25-49b3-a877-f1a9eeb1f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:28.588559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0162e-cb25-49b3-a877-f1a9eeb1f69f None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:28.588837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0162e-cb25-49b3-a877-f1a9eeb1f69f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:28.589108 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0162e-cb25-49b3-a877-f1a9eeb1f69f None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:28.589749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0162e-cb25-49b3-a877-f1a9eeb1f69f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:28.591179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0162e-cb25-49b3-a877-f1a9eeb1f69f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:28.655608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 587/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:06:28 2022] POST /identity/v3/users => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:06:30.665563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8731a5-f20e-49db-85d4-92d364f721be None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:30.666096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8731a5-f20e-49db-85d4-92d364f721be None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:30.666096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8731a5-f20e-49db-85d4-92d364f721be None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:30.667435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 591/1178] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:30.673498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150def4-d270-46f2-bb74-e62481a86927 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:30.673933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150def4-d270-46f2-bb74-e62481a86927 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:30.674028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150def4-d270-46f2-bb74-e62481a86927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:30.691462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c150def4-d270-46f2-bb74-e62481a86927 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:30.692651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c150def4-d270-46f2-bb74-e62481a86927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:30.756079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 588/1179] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:30.779641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8731a5-f20e-49db-85d4-92d364f721be None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:30.879365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8731a5-f20e-49db-85d4-92d364f721be None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:30.912010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb40944-834c-43d6-bb22-92dad121e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:30.912663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb40944-834c-43d6-bb22-92dad121e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:30.912943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb40944-834c-43d6-bb22-92dad121e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:30.913214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb40944-834c-43d6-bb22-92dad121e3c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:30.920446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:30.924024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb40944-834c-43d6-bb22-92dad121e3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-6bb40944-834c-43d6-bb22-92dad121e3c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:06:30.928646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:06:30.929739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:06:30.930582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 592/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:06:30.935739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150def4-d270-46f2-bb74-e62481a86927 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:30.953453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:31.033227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150def4-d270-46f2-bb74-e62481a86927 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:31.065954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:31.066556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:31.066839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:31.067115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:31.067773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:31.068076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:31.069472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:31.077199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 589/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:31.083012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb40944-834c-43d6-bb22-92dad121e3c5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:31.179399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb40944-834c-43d6-bb22-92dad121e3c5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:31.211797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd058980-068d-45a7-905f-63088c326e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:31.212440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd058980-068d-45a7-905f-63088c326e7c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:31.212722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd058980-068d-45a7-905f-63088c326e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:31.212992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd058980-068d-45a7-905f-63088c326e7c None admin] PATH_INFO: `/v3/users/59ccc44de6064de18d3d0c29ce867049` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:31.225439 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd058980-068d-45a7-905f-63088c326e7c None admin] RBAC: Authorizing `identity:get_user(user_id=59ccc44de6064de18d3d0c29ce867049)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:31.226863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd058980-068d-45a7-905f-63088c326e7c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:31.228422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 593/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:31 2022] GET /identity/v3/users/59ccc44de6064de18d3d0c29ce867049 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:31.234018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:31.309012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:31.329415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1c3a0-f234-4574-b3d4-07371e1b700f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:31.360933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848ea84-2e2c-4deb-b672-0c4d560de11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:31.361527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848ea84-2e2c-4deb-b672-0c4d560de11e None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:31.361802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848ea84-2e2c-4deb-b672-0c4d560de11e None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:31.362068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848ea84-2e2c-4deb-b672-0c4d560de11e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:31.426458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848ea84-2e2c-4deb-b672-0c4d560de11e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:31.427901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848ea84-2e2c-4deb-b672-0c4d560de11e None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:31.501731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:31.523219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 590/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:06:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:31.529110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd058980-068d-45a7-905f-63088c326e7c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:31.585579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:31.624567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd058980-068d-45a7-905f-63088c326e7c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:31.659537 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2245e-3481-4d5a-a105-ac649a22e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:31.660146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2245e-3481-4d5a-a105-ac649a22e15c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:31.660451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2245e-3481-4d5a-a105-ac649a22e15c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:31.660722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2245e-3481-4d5a-a105-ac649a22e15c None admin] PATH_INFO: `/v3/projects/7e62af70a9f7453db4c5f0ff071406a0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:31.661806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2245e-3481-4d5a-a105-ac649a22e15c None admin] RBAC: Authorizing `identity:get_project(project_id=7e62af70a9f7453db4c5f0ff071406a0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:31.663208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2245e-3481-4d5a-a105-ac649a22e15c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:31.664813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 594/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:06:31 2022] GET /identity/v3/projects/7e62af70a9f7453db4c5f0ff071406a0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:31.670790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848ea84-2e2c-4deb-b672-0c4d560de11e None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:31.765543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848ea84-2e2c-4deb-b672-0c4d560de11e None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:31.797716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078c745-53ca-4a84-a310-fd7b030a07f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:31.798297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c745-53ca-4a84-a310-fd7b030a07f1 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:31.798572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c745-53ca-4a84-a310-fd7b030a07f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:31.798838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078c745-53ca-4a84-a310-fd7b030a07f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:31.799547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078c745-53ca-4a84-a310-fd7b030a07f1 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=7e62af70a9f7453db4c5f0ff071406a0, user.id=59ccc44de6064de18d3d0c29ce867049) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:31.799849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078c745-53ca-4a84-a310-fd7b030a07f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:31.801282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078c745-53ca-4a84-a310-fd7b030a07f1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:31.806311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 591/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:06:31 2022] GET /identity/v3/role_assignments?user.id=59ccc44de6064de18d3d0c29ce867049&scope.project.id=7e62af70a9f7453db4c5f0ff071406a0&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:33.750992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38149c31-c800-4f41-9f2f-7e310e97b6ac None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:33.751527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38149c31-c800-4f41-9f2f-7e310e97b6ac None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:33.751527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38149c31-c800-4f41-9f2f-7e310e97b6ac None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:33.752858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 595/1186] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:33.758031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c77cea-b9de-4f5a-af3a-e7d50d9c69bc None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:33.758421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c77cea-b9de-4f5a-af3a-e7d50d9c69bc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:33.758564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c77cea-b9de-4f5a-af3a-e7d50d9c69bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:33.775842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-33c77cea-b9de-4f5a-af3a-e7d50d9c69bc None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:33.777020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-33c77cea-b9de-4f5a-af3a-e7d50d9c69bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:33.810998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:33.841185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 592/1187] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:33.864242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38149c31-c800-4f41-9f2f-7e310e97b6ac None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:33.962467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38149c31-c800-4f41-9f2f-7e310e97b6ac None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:33.988729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:33.997013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c4089-457b-434c-a22a-5e0c6763291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:33.999559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c4089-457b-434c-a22a-5e0c6763291c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:33.999559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c4089-457b-434c-a22a-5e0c6763291c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:33.999559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c4089-457b-434c-a22a-5e0c6763291c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:34.008000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c4089-457b-434c-a22a-5e0c6763291c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-063c4089-457b-434c-a22a-5e0c6763291c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:06:34.012605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:06:34.013742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:06:34.014790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 596/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:06:34.019922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c77cea-b9de-4f5a-af3a-e7d50d9c69bc None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:34.115029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c77cea-b9de-4f5a-af3a-e7d50d9c69bc None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:34.147659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:34.148257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:34.148564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:34.148837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:34.149500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:34.149803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:34.151152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:34.159086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 593/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:34.164838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c4089-457b-434c-a22a-5e0c6763291c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:34.260997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c4089-457b-434c-a22a-5e0c6763291c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:34.294166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f9fc-1eb4-4e51-bd67-cb33a8defa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:34.294775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f9fc-1eb4-4e51-bd67-cb33a8defa02 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:34.295055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f9fc-1eb4-4e51-bd67-cb33a8defa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:34.295328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f9fc-1eb4-4e51-bd67-cb33a8defa02 None admin] PATH_INFO: `/v3/users/59ccc44de6064de18d3d0c29ce867049` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:34.296454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582f9fc-1eb4-4e51-bd67-cb33a8defa02 None admin] RBAC: Authorizing `identity:get_user(user_id=59ccc44de6064de18d3d0c29ce867049)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:34.297953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582f9fc-1eb4-4e51-bd67-cb33a8defa02 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:34.299487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 597/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:34 2022] GET /identity/v3/users/59ccc44de6064de18d3d0c29ce867049 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:34.305165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:34.338407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:34.401951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b880d4-9c78-4a56-85b3-b34eb565bbb5 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:34.434964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2241a-fdc6-4cf3-9d93-a8da6ed0c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:34.435588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2241a-fdc6-4cf3-9d93-a8da6ed0c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:34.435865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2241a-fdc6-4cf3-9d93-a8da6ed0c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:34.436133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2241a-fdc6-4cf3-9d93-a8da6ed0c4f6 None admin] PATH_INFO: `/v3/projects/7e62af70a9f7453db4c5f0ff071406a0` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:34.437252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2241a-fdc6-4cf3-9d93-a8da6ed0c4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=7e62af70a9f7453db4c5f0ff071406a0)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:34.439233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2241a-fdc6-4cf3-9d93-a8da6ed0c4f6 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:34.440859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 594/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:06:34 2022] GET /identity/v3/projects/7e62af70a9f7453db4c5f0ff071406a0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:06:34.446791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f9fc-1eb4-4e51-bd67-cb33a8defa02 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:34.500591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:34.544056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f9fc-1eb4-4e51-bd67-cb33a8defa02 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:34.577379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333a4c-4ed8-4a76-8a23-7962645a6df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:34.578030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333a4c-4ed8-4a76-8a23-7962645a6df6 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:34.579009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333a4c-4ed8-4a76-8a23-7962645a6df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:34.579371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333a4c-4ed8-4a76-8a23-7962645a6df6 None admin] PATH_INFO: `/v3/projects/7e62af70a9f7453db4c5f0ff071406a0/users/59ccc44de6064de18d3d0c29ce867049/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:34.581288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333a4c-4ed8-4a76-8a23-7962645a6df6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e62af70a9f7453db4c5f0ff071406a0, user_id=59ccc44de6064de18d3d0c29ce867049, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:34.582707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333a4c-4ed8-4a76-8a23-7962645a6df6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:34.654946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 598/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:06:34 2022] PUT /identity/v3/projects/7e62af70a9f7453db4c5f0ff071406a0/users/59ccc44de6064de18d3d0c29ce867049/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:06:36.609963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f245d40-19b4-4781-a58f-fadf78d1db6b None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:36.610498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f245d40-19b4-4781-a58f-fadf78d1db6b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:36.610498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f245d40-19b4-4781-a58f-fadf78d1db6b None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:36.612476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 595/1193] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:06:36.617702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f27a-7080-463f-a0a5-2046f46df430 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:36.618119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f27a-7080-463f-a0a5-2046f46df430 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:36.618254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f27a-7080-463f-a0a5-2046f46df430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:36.636412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7c00f27a-7080-463f-a0a5-2046f46df430 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:06:36.637571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7c00f27a-7080-463f-a0a5-2046f46df430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:06:36.701976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 599/1194] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:06:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:06:36.724560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f245d40-19b4-4781-a58f-fadf78d1db6b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:36.824149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f245d40-19b4-4781-a58f-fadf78d1db6b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:36.825332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:36.856387 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bada8-722e-4017-926b-3b5a326dc012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:36.857003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bada8-722e-4017-926b-3b5a326dc012 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:36.857276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bada8-722e-4017-926b-3b5a326dc012 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:36.857542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bada8-722e-4017-926b-3b5a326dc012 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:36.867709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bada8-722e-4017-926b-3b5a326dc012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-d32bada8-722e-4017-926b-3b5a326dc012 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:06:36.872665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:06:36.873792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:06:36.874777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 596/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:06:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:06:36.880785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f27a-7080-463f-a0a5-2046f46df430 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:36.923758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:36.974585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f27a-7080-463f-a0a5-2046f46df430 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:37.008327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:37.008940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:37.009218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:37.009485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:37.010138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:37.010433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:37.011774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:37.019412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 600/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:06:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:37.025067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bada8-722e-4017-926b-3b5a326dc012 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:37.121941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bada8-722e-4017-926b-3b5a326dc012 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:37.154709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a638e-24fe-4422-a10f-dbe717e5bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:37.155318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a638e-24fe-4422-a10f-dbe717e5bb12 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:37.155592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a638e-24fe-4422-a10f-dbe717e5bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:37.155856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a638e-24fe-4422-a10f-dbe717e5bb12 None admin] PATH_INFO: `/v3/users/59ccc44de6064de18d3d0c29ce867049` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:37.157206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a638e-24fe-4422-a10f-dbe717e5bb12 None admin] RBAC: Authorizing `identity:get_user(user_id=59ccc44de6064de18d3d0c29ce867049)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:37.158627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a638e-24fe-4422-a10f-dbe717e5bb12 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:37.160217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 597/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 10 11:06:37 2022] GET /identity/v3/users/59ccc44de6064de18d3d0c29ce867049 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:37.165943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:37.259673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cb725-b5f0-4b6b-9109-435fa80f303d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:37.266753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:37.291878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bad5d-d1bd-44b6-9763-5a5aaca9dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:37.292497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bad5d-d1bd-44b6-9763-5a5aaca9dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:37.292774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bad5d-d1bd-44b6-9763-5a5aaca9dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:37.293040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bad5d-d1bd-44b6-9763-5a5aaca9dcf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:37.357810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bad5d-d1bd-44b6-9763-5a5aaca9dcf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:37.359252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bad5d-d1bd-44b6-9763-5a5aaca9dcf1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:37.453719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 601/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:06:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:06:37.459446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a638e-24fe-4422-a10f-dbe717e5bb12 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:37.489119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:37.555356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a638e-24fe-4422-a10f-dbe717e5bb12 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:37.587958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf3bb9-ed41-4d8e-b880-e221b5eabe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:37.588602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3bb9-ed41-4d8e-b880-e221b5eabe2b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:37.588882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3bb9-ed41-4d8e-b880-e221b5eabe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:37.589155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3bb9-ed41-4d8e-b880-e221b5eabe2b None admin] PATH_INFO: `/v3/projects/7e62af70a9f7453db4c5f0ff071406a0` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:37.590275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf3bb9-ed41-4d8e-b880-e221b5eabe2b None admin] RBAC: Authorizing `identity:get_project(project_id=7e62af70a9f7453db4c5f0ff071406a0)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:37.591694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf3bb9-ed41-4d8e-b880-e221b5eabe2b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:37.593339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 598/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 10 11:06:37 2022] GET /identity/v3/projects/7e62af70a9f7453db4c5f0ff071406a0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:37.599351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bad5d-d1bd-44b6-9763-5a5aaca9dcf1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:06:37.607169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:37.695780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bad5d-d1bd-44b6-9763-5a5aaca9dcf1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:06:37.728069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eebe1-6579-4564-8ece-4d1993a7f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:06:37.728631 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eebe1-6579-4564-8ece-4d1993a7f772 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:06:37.728912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eebe1-6579-4564-8ece-4d1993a7f772 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:06:37.729183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eebe1-6579-4564-8ece-4d1993a7f772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:06:37.729899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eebe1-6579-4564-8ece-4d1993a7f772 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=7e62af70a9f7453db4c5f0ff071406a0, user.id=59ccc44de6064de18d3d0c29ce867049) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:06:37.730231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eebe1-6579-4564-8ece-4d1993a7f772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:06:37.731633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36eebe1-6579-4564-8ece-4d1993a7f772 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:06:37.737861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 602/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:06:37 2022] GET /identity/v3/role_assignments?user.id=59ccc44de6064de18d3d0c29ce867049&scope.project.id=7e62af70a9f7453db4c5f0ff071406a0&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:06:47.583913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=51 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:06:47.735243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=65 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:49.076705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82392007-90f1-4b4e-bd81-cbf28d5df5ba None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:49.077258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82392007-90f1-4b4e-bd81-cbf28d5df5ba None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:49.077258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82392007-90f1-4b4e-bd81-cbf28d5df5ba None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:49.078405 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 599/1201] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:07:49.083706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cecc08-fa6a-48f7-9f1f-9fc5451390de None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:49.089800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cecc08-fa6a-48f7-9f1f-9fc5451390de None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:49.089800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cecc08-fa6a-48f7-9f1f-9fc5451390de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:49.103267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-76cecc08-fa6a-48f7-9f1f-9fc5451390de None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:07:49.104537 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-76cecc08-fa6a-48f7-9f1f-9fc5451390de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:07:49.170135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 603/1202] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:07:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:07:49.194669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82392007-90f1-4b4e-bd81-cbf28d5df5ba None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:49.291588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82392007-90f1-4b4e-bd81-cbf28d5df5ba None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:49.324866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:49.325480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:49.325762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:49.326028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:49.335676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:49.337074 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:07:49.350981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:49.352206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:07:49.353476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:07:49.353476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:49.353476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:07:49.353476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 600/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:49.358353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cecc08-fa6a-48f7-9f1f-9fc5451390de None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:49.455631 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cecc08-fa6a-48f7-9f1f-9fc5451390de None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:49.483830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:49.489512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780435ad-4ea2-48a8-97f1-2961c06761be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:49.490115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780435ad-4ea2-48a8-97f1-2961c06761be None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:49.490397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780435ad-4ea2-48a8-97f1-2961c06761be None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:49.490670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780435ad-4ea2-48a8-97f1-2961c06761be None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:49.491313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780435ad-4ea2-48a8-97f1-2961c06761be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:49.491616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780435ad-4ea2-48a8-97f1-2961c06761be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:49.493022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780435ad-4ea2-48a8-97f1-2961c06761be None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:49.504448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 604/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:49.510177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:49.562302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:49.607836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e84d6-7004-4790-ad49-07eb90d41476 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:49.639713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd36f0e-3b2a-4230-903a-1f79e8299ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:49.640332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36f0e-3b2a-4230-903a-1f79e8299ce4 None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:49.640607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36f0e-3b2a-4230-903a-1f79e8299ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:49.640877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36f0e-3b2a-4230-903a-1f79e8299ce4 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:49.641529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd36f0e-3b2a-4230-903a-1f79e8299ce4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:49.642947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd36f0e-3b2a-4230-903a-1f79e8299ce4 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:49.746887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 601/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 10 11:07:49 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:07:51.771940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728cc5e-85af-418a-a984-29a6aad93e7d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:51.772556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728cc5e-85af-418a-a984-29a6aad93e7d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:51.772556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728cc5e-85af-418a-a984-29a6aad93e7d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:51.773877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 605/1206] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:07:51.780193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd13e-9939-40a3-8391-87e6610c4bf8 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:51.780642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd13e-9939-40a3-8391-87e6610c4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:51.780773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd13e-9939-40a3-8391-87e6610c4bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:51.799024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-697fd13e-9939-40a3-8391-87e6610c4bf8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:07:51.800207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-697fd13e-9939-40a3-8391-87e6610c4bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:07:51.865935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 602/1207] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:07:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:07:51.889514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728cc5e-85af-418a-a984-29a6aad93e7d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:51.990763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728cc5e-85af-418a-a984-29a6aad93e7d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:52.024116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430af0d-bf01-40e7-a02a-8798807d4c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:52.024966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430af0d-bf01-40e7-a02a-8798807d4c52 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:52.025241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430af0d-bf01-40e7-a02a-8798807d4c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:52.025546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430af0d-bf01-40e7-a02a-8798807d4c52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:52.035823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430af0d-bf01-40e7-a02a-8798807d4c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1430af0d-bf01-40e7-a02a-8798807d4c52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:07:52.040497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:52.041609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:07:52.042480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 606/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:07:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:52.047959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd13e-9939-40a3-8391-87e6610c4bf8 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:52.087963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:52.145392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd13e-9939-40a3-8391-87e6610c4bf8 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:52.185901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:52.186555 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:52.186832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:52.187099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:52.187758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:52.188052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:52.189447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:52.197286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 603/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:07:52.204011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430af0d-bf01-40e7-a02a-8798807d4c52 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:52.253069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:52.302285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430af0d-bf01-40e7-a02a-8798807d4c52 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:52.335700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:52.336340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:52.336628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:52.336901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:52.346673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:52.348089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:07:52.361994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:52.364199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:07:52.365200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:07:52.365200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:52.365200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:07:52.365200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 607/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:52.368887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:52.463257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:52.466178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07f5ce-d412-41a3-8dc2-288095d84a50 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:52.498882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:52.499480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:52.499760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:52.500032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:52.500691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:52.500990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:52.502340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:52.513658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 604/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:52.519598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:52.618165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec784-54ee-4954-99e4-1400d9e7a283 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:52.620185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:52.651552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:52.652171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:52.652480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:52.652751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:52.659908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:52.661379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:07:52.672609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:52.673718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:07:52.675054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 608/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:07:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:52.679447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:52.777678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010ece2-157f-458e-a789-7c0d4bd45303 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:52.810938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:52.811584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:52.812499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:52.812499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:52.812829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:52.813129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:52.814546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:52.831636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 605/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 11:07:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:52.837442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:52.938681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ecbda-b6eb-4ee9-b682-1c0dd5ef8153 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:52.970787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e888a-cf62-43b1-a12a-a6b8de2aa03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:52.971385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e888a-cf62-43b1-a12a-a6b8de2aa03c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:52.971662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e888a-cf62-43b1-a12a-a6b8de2aa03c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:52.971930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e888a-cf62-43b1-a12a-a6b8de2aa03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:53.001587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:53.037827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e888a-cf62-43b1-a12a-a6b8de2aa03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:53.039216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e888a-cf62-43b1-a12a-a6b8de2aa03c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:53.134528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 609/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:07:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:07:53.141195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:53.159610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:53.237798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b0abc-67c4-41c6-b34d-8518c13219f1 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:53.270737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:53.271357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:53.271631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:53.271899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:53.281679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:53.283110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:07:53.297260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:53.301155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:07:53.302293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:07:53.302293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:53.302293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:07:53.302293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 606/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:53.304069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e888a-cf62-43b1-a12a-a6b8de2aa03c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:53.365322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:53.401829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e888a-cf62-43b1-a12a-a6b8de2aa03c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:53.434940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:53.435609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:53.435888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:53.436158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:53.436823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:53.437124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:53.438468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:53.450009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 610/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:53.455471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:53.522128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:53.552681 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af848bbb-eae9-47e2-9ec6-4f5c61b458e8 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:53.584791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:53.585714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:53.586168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:53.586510 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:53.593587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:53.595063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:07:53.606432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:53.607414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:07:53.608512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 607/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:53.613506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:53.714262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c7d68-4bf0-40cf-9532-12c1bbed1c7b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:53.736043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:53.747105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b96a62-be17-4724-a87c-11d9be76a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:53.747713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96a62-be17-4724-a87c-11d9be76a819 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:53.747994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96a62-be17-4724-a87c-11d9be76a819 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:53.748266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b96a62-be17-4724-a87c-11d9be76a819 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:53.749008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b96a62-be17-4724-a87c-11d9be76a819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:53.749287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b96a62-be17-4724-a87c-11d9be76a819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:53.750702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b96a62-be17-4724-a87c-11d9be76a819 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:53.761765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 611/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:53.767841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:53.868938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc37954-a031-4870-bd3a-cfcbd501449d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:53.897356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:53.903388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84405d-44da-4561-8496-86bcc02f2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:53.903986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84405d-44da-4561-8496-86bcc02f2a2a None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:53.904261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84405d-44da-4561-8496-86bcc02f2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:53.904563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84405d-44da-4561-8496-86bcc02f2a2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:53.905314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84405d-44da-4561-8496-86bcc02f2a2a None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=84db64968844438b96d04172cfd0e925) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:53.905651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84405d-44da-4561-8496-86bcc02f2a2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:53.907059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84405d-44da-4561-8496-86bcc02f2a2a None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:53.912113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 608/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:07:53 2022] GET /identity/v3/role_assignments?user.id=84db64968844438b96d04172cfd0e925&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:55.876624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244039-6d8c-41ac-8854-99040d5cf05a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:55.877135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244039-6d8c-41ac-8854-99040d5cf05a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:55.877247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3244039-6d8c-41ac-8854-99040d5cf05a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:55.878480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 612/1220] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:07:55.883764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886d69-abc6-4447-a3eb-fe883c29c569 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:55.884189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886d69-abc6-4447-a3eb-fe883c29c569 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:55.884346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886d69-abc6-4447-a3eb-fe883c29c569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:55.902578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-60886d69-abc6-4447-a3eb-fe883c29c569 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:07:55.903751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-60886d69-abc6-4447-a3eb-fe883c29c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:07:55.967903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 609/1221] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:07:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:07:55.990726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244039-6d8c-41ac-8854-99040d5cf05a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:56.089990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3244039-6d8c-41ac-8854-99040d5cf05a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:56.122688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e35ad-ed3d-48e2-a8ad-2b6245e74b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:56.123314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e35ad-ed3d-48e2-a8ad-2b6245e74b59 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:56.123588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e35ad-ed3d-48e2-a8ad-2b6245e74b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:56.123855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e35ad-ed3d-48e2-a8ad-2b6245e74b59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:56.134094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e35ad-ed3d-48e2-a8ad-2b6245e74b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-818e35ad-ed3d-48e2-a8ad-2b6245e74b59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:07:56.139566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:56.140616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:07:56.141450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 613/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:56.146661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60886d69-abc6-4447-a3eb-fe883c29c569 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:56.245775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60886d69-abc6-4447-a3eb-fe883c29c569 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:56.268519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:56.279350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:56.279979 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:56.280261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:56.280562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:56.281227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] RBAC: Adding query filter params (name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:56.281531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:56.282922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:56.290613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 610/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:56.297381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e35ad-ed3d-48e2-a8ad-2b6245e74b59 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:56.341102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:56.400597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e35ad-ed3d-48e2-a8ad-2b6245e74b59 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:56.433439 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:56.434059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:56.434333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:56.434601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:56.444591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:56.446017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:07:56.459595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:56.460701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:07:56.461704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:07:56.461704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:56.461704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:07:56.461704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 614/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:56.466706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:56.565577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a09eb5-744f-42a4-8f64-c5c9191c4816 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:56.602020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:56.602551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:56.602827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:56.603095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:56.604245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:56.604572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:56.605923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:56.617285 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 611/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:56.623933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:56.715576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:56.722038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2d233-8743-475a-a597-c07b8c33bcc0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:56.754528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:56.755144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:56.755470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:56.755743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:56.762427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:56.763841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:07:56.775006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:56.776735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:07:56.777864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 615/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:07:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:56.782596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:56.830635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:56.882210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea05e81-2d70-4ffb-8bcf-fada311f9bb7 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:56.915223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:56.915830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:56.916674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:56.916947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:56.917668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:56.917958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:56.921493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:56.936258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 612/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 11:07:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:56.942177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:57.038618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8facaa-2ae8-41d3-b92a-948c94b8f345 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:57.071507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:57.072115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:57.072446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:57.072740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:57.083928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:57.085405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:07:57.099364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:57.100547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:07:57.101613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:07:57.101613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:07:57.101613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:07:57.101613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 616/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:57.106819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:57.206515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c357a-b0d7-449f-a5ff-d6f74c0138fd None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:57.208749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:57.239931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:57.240725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:57.241003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:57.241271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:57.241903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:57.242252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:57.243602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:57.255229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 613/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:57.261078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:57.270647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:57.358728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd73ded-f21b-49db-a550-d09988a23f96 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:57.391523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:57.392177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:57.392497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:57.392773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:57.399424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:57.401381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:07:57.412207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:07:57.413336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:07:57.414442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 617/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:07:57.419887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:57.516409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712bbb4-cf5a-40c5-b21c-5e8e0213267d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:57.549472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d238e-8436-4c40-82ce-e568d8786c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:57.550069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d238e-8436-4c40-82ce-e568d8786c81 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:57.550347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d238e-8436-4c40-82ce-e568d8786c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:57.550620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d238e-8436-4c40-82ce-e568d8786c81 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:57.551312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d238e-8436-4c40-82ce-e568d8786c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:07:57.551610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d238e-8436-4c40-82ce-e568d8786c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:57.553059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d238e-8436-4c40-82ce-e568d8786c81 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:57.565136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 614/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:07:57.571136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:57.635923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:07:57.669442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f88cd-0b59-4fd5-b3f7-66f0dda65840 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:07:57.702669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd01137-7c66-4c06-b024-93e6e37a5c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:07:57.703330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd01137-7c66-4c06-b024-93e6e37a5c79 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:57.703612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd01137-7c66-4c06-b024-93e6e37a5c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:57.703887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd01137-7c66-4c06-b024-93e6e37a5c79 None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/84db64968844438b96d04172cfd0e925/roles/e35eda3b7be4479380b1dbba47f6556f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:57.718446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd01137-7c66-4c06-b024-93e6e37a5c79 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=84db64968844438b96d04172cfd0e925, role_id=e35eda3b7be4479380b1dbba47f6556f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:07:57.721564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd01137-7c66-4c06-b024-93e6e37a5c79 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:07:57.815553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 618/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:07:57 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/84db64968844438b96d04172cfd0e925/roles/e35eda3b7be4479380b1dbba47f6556f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:07:59.809321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f339ff0-5aec-419c-ad6b-77b7a2aa230e None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:59.809860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f339ff0-5aec-419c-ad6b-77b7a2aa230e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:59.809860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f339ff0-5aec-419c-ad6b-77b7a2aa230e None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:59.811221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 615/1233] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:07:59.816569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fe784-b27d-4d5c-8571-c049b9a36b4a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:07:59.816992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fe784-b27d-4d5c-8571-c049b9a36b4a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:07:59.817114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fe784-b27d-4d5c-8571-c049b9a36b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:07:59.835441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-211fe784-b27d-4d5c-8571-c049b9a36b4a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:07:59.836662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-211fe784-b27d-4d5c-8571-c049b9a36b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:07:59.902100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 619/1234] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:07:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 11:07:59.925425 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f339ff0-5aec-419c-ad6b-77b7a2aa230e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:07:59.950800 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:00.023716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f339ff0-5aec-419c-ad6b-77b7a2aa230e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:00.058381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b6b78-5254-4a41-8b7b-f49f61aec06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:00.059009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b6b78-5254-4a41-8b7b-f49f61aec06f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:00.059289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b6b78-5254-4a41-8b7b-f49f61aec06f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:00.059609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b6b78-5254-4a41-8b7b-f49f61aec06f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:00.069363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b6b78-5254-4a41-8b7b-f49f61aec06f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-219b6b78-5254-4a41-8b7b-f49f61aec06f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:08:00.074180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:00.075321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:00.076217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 616/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 10 11:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:00.081413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fe784-b27d-4d5c-8571-c049b9a36b4a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:00.125838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:00.174939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fe784-b27d-4d5c-8571-c049b9a36b4a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:00.208679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:00.209281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:00.209580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:00.209848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:00.210503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:00.210800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:00.212142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:00.219907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 620/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 10 11:08:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:00.225720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b6b78-5254-4a41-8b7b-f49f61aec06f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:00.317512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:00.332843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b6b78-5254-4a41-8b7b-f49f61aec06f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:00.366142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:00.366766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:00.367049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:00.367325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:00.378116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:00.379547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:08:00.394002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:00.395140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:08:00.396055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:08:00.396055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:00.396055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:00.396055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 617/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:00.401791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:00.498339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779c6f4-86e1-4e64-bb87-aac860f9dda2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:00.506885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:00.530902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:00.531505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:00.531779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:00.532048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:00.532718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:00.533019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:00.534375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:00.545585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 621/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:08:00.551211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:00.649305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4eaee-f578-4f84-9917-d1d248921f1d None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:00.682142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:00.682756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:00.683029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:00.683294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:00.685884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:00.690610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:00.692038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:08:00.703095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:00.704859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:00.706116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 618/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:00.709952 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:00.809495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad0973-f52c-4cda-8899-a7e0071ff40f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:00.842990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:00.843620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:00.843866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:00.844132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:00.844881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:00.845181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:00.846578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:00.863707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 622/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 11:08:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:00.870112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:00.965498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405029a-fbfd-4fc9-a9d8-a3ff5d6b0d53 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:00.999381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbfe36-5d16-4927-afd9-97da712c5583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:00.999958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbfe36-5d16-4927-afd9-97da712c5583 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:01.000234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbfe36-5d16-4927-afd9-97da712c5583 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:01.000531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbfe36-5d16-4927-afd9-97da712c5583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:01.059886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:01.066130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbfe36-5d16-4927-afd9-97da712c5583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:01.067620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbfe36-5d16-4927-afd9-97da712c5583 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:01.162852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 619/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:08:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:08:01.169330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:01.196030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:01.270293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554817c-2540-4e17-938d-3c10bd7616eb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:01.303232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:01.303840 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:01.304115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:01.304414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:01.318560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:01.319977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:08:01.334723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:01.339757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:08:01.340905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:08:01.340905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:01.340905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:01.340905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 623/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:01.342303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbfe36-5d16-4927-afd9-97da712c5583 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:01.432289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:01.437782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbfe36-5d16-4927-afd9-97da712c5583 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:01.470708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:01.471313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:01.471593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:01.471863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:01.472536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:01.472840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:01.474195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:01.485840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 620/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:01.491802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:01.568099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:01.589528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7055e9-d96d-4b4e-be79-22d0f535e559 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:01.623452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:01.624084 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:01.624389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:01.624663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:01.631624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:01.633085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:08:01.645074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:01.646113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:01.647247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 624/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:01.653306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:01.750464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffa2cf-9642-4275-9153-f18d79f2e37b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:01.784147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73697ae7-f440-4ba6-b3b5-0031fd94691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:01.784778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73697ae7-f440-4ba6-b3b5-0031fd94691c None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:01.785060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73697ae7-f440-4ba6-b3b5-0031fd94691c None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:01.785336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73697ae7-f440-4ba6-b3b5-0031fd94691c None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:01.786075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73697ae7-f440-4ba6-b3b5-0031fd94691c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:01.786383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73697ae7-f440-4ba6-b3b5-0031fd94691c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:01.787813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73697ae7-f440-4ba6-b3b5-0031fd94691c None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:01.799802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 621/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:01.805919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:01.910701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365453-b1f3-41f7-823d-8eb5020199a6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:01.943399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e7018-4139-4b84-90bb-64a2768a58ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:01.944098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e7018-4139-4b84-90bb-64a2768a58ad None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:01.944414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e7018-4139-4b84-90bb-64a2768a58ad None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:01.944691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e7018-4139-4b84-90bb-64a2768a58ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:01.945417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e7018-4139-4b84-90bb-64a2768a58ad None admin] RBAC: Adding query filter params (role.id=e35eda3b7be4479380b1dbba47f6556f, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=84db64968844438b96d04172cfd0e925) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:01.945724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e7018-4139-4b84-90bb-64a2768a58ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:01.947749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e7018-4139-4b84-90bb-64a2768a58ad None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:01.953526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 625/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:08:01 2022] GET /identity/v3/role_assignments?user.id=84db64968844438b96d04172cfd0e925&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=e35eda3b7be4479380b1dbba47f6556f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:03.992672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94c07-430d-45e5-8f06-d5130c772dc9 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:03.993219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94c07-430d-45e5-8f06-d5130c772dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:03.993219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94c07-430d-45e5-8f06-d5130c772dc9 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:03.995157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 622/1247] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:04.000254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342306-cade-460c-bea6-6a78d629361f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:04.000684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342306-cade-460c-bea6-6a78d629361f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:04.000859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342306-cade-460c-bea6-6a78d629361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:04.007169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:04.019249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-70342306-cade-460c-bea6-6a78d629361f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:04.020784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-70342306-cade-460c-bea6-6a78d629361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:04.084996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 626/1248] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:08:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:08:04.108601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d94c07-430d-45e5-8f06-d5130c772dc9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:04.127242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:04.206286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d94c07-430d-45e5-8f06-d5130c772dc9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:04.240215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94a4b-5d04-4b29-8e6d-75a4a60bd389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:04.240864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94a4b-5d04-4b29-8e6d-75a4a60bd389 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:04.241143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94a4b-5d04-4b29-8e6d-75a4a60bd389 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:04.241413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c94a4b-5d04-4b29-8e6d-75a4a60bd389 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:04.251693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c94a4b-5d04-4b29-8e6d-75a4a60bd389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-d6c94a4b-5d04-4b29-8e6d-75a4a60bd389 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:08:04.256360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:04.257457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:04.258699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 623/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:04.263550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70342306-cade-460c-bea6-6a78d629361f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:04.359643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70342306-cade-460c-bea6-6a78d629361f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:04.388831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:04.393986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:04.394600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:04.394883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:04.395157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:04.395822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:04.396229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:04.397558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:04.406059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 627/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:04.414332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94a4b-5d04-4b29-8e6d-75a4a60bd389 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:04.491474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:04.513989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c94a4b-5d04-4b29-8e6d-75a4a60bd389 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:04.547604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:04.548226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:04.548535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:04.548806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:04.559012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:04.560486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:08:04.574200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:04.579627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:08:04.580892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:08:04.580892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:04.580892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:04.580892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 624/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:08:04.581174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:04.676975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150de51-30cf-4bbc-b894-1a1b28a91cb2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:04.709054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:04.709651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:04.709927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:04.710221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:04.710854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:04.711147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:04.712630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:04.723869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 628/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:04.730156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:04.828636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f099542-8487-4162-98ec-dd76c0308355 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:04.854751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:04.862223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:04.862844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:04.863124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:04.863398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:04.871520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:04.874525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:08:04.884063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:04.885286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:04.886522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 625/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:04.891326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:04.945868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:04.988254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414575-f14c-48b6-aa88-d388cda18be7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:05.022103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:05.022765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:05.022974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:05.023245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:05.024227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:05.025085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:05.026521 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:05.043478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 629/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 11:08:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:05.049303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:05.145400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738ba5-d3ac-48b4-895f-c931465228a9 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:05.182049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085dea6-f231-433a-ab4f-655bf258d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:05.182628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085dea6-f231-433a-ab4f-655bf258d23b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:05.182907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085dea6-f231-433a-ab4f-655bf258d23b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:05.183175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085dea6-f231-433a-ab4f-655bf258d23b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:05.237836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:05.250198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085dea6-f231-433a-ab4f-655bf258d23b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:05.251685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085dea6-f231-433a-ab4f-655bf258d23b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:05.348246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 626/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:08:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:08:05.354234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:05.452325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37d5f2-f3bc-40be-ac05-0bfb2c4b2b19 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:05.466884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:05.487143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:05.487813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:05.488136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:05.488404 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:05.498239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:05.499696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:08:05.514173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:05.515287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:08:05.516640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:08:05.516640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:05.516640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:05.516640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 630/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:05.521031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085dea6-f231-433a-ab4f-655bf258d23b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:05.606475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:05.617893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085dea6-f231-433a-ab4f-655bf258d23b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:05.651444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:05.652071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:05.652370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:05.652641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:05.653273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:05.653597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:05.655044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:05.666197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 627/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:05.671958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:05.773027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d4e5e-815b-4230-84be-01bb184228e0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:05.807532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:05.808188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:05.808494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:05.808765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:05.815487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:05.816999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:08:05.829208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:05.830282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:05.831406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 631/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:05.836652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:05.934237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efeae5-7cab-48f3-82df-71aa99731b26 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:05.967538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5643be-e584-4821-93f2-85d17b60ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:05.968144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5643be-e584-4821-93f2-85d17b60ece0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:05.968454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5643be-e584-4821-93f2-85d17b60ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:05.968731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5643be-e584-4821-93f2-85d17b60ece0 None admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:05.969422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5643be-e584-4821-93f2-85d17b60ece0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:05.969787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5643be-e584-4821-93f2-85d17b60ece0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:05.971511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5643be-e584-4821-93f2-85d17b60ece0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:05.984489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 628/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:05.990568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:06.016179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:06.091184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ff09-d37b-45b3-acb7-aefe5f282d15 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:06.122950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9d59-5ea4-4014-9f93-6420b1948d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:06.123548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9d59-5ea4-4014-9f93-6420b1948d10 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:06.123824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9d59-5ea4-4014-9f93-6420b1948d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:06.124089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9d59-5ea4-4014-9f93-6420b1948d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:06.124835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9d59-5ea4-4014-9f93-6420b1948d10 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=84db64968844438b96d04172cfd0e925) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:06.125137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9d59-5ea4-4014-9f93-6420b1948d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:06.126536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9d59-5ea4-4014-9f93-6420b1948d10 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:06.131709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 632/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:08:05 2022] GET /identity/v3/role_assignments?user.id=84db64968844438b96d04172cfd0e925&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:08.122392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef1a-d4a5-4300-b60a-19662cd20872 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:08.122915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef1a-d4a5-4300-b60a-19662cd20872 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:08.122915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef1a-d4a5-4300-b60a-19662cd20872 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:08.124232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 629/1261] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:08.129282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742694dc-d139-4819-b020-088c244493a8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:08.129694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742694dc-d139-4819-b020-088c244493a8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:08.129833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742694dc-d139-4819-b020-088c244493a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:08.148081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-742694dc-d139-4819-b020-088c244493a8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:08.149569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-742694dc-d139-4819-b020-088c244493a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:08.214149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 633/1262] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:08:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:08:08.236683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ef1a-d4a5-4300-b60a-19662cd20872 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:08.248851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:08.338301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ef1a-d4a5-4300-b60a-19662cd20872 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:08.373741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31774066-9f9f-4d06-8b58-fffd4b1ee8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:08.374297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31774066-9f9f-4d06-8b58-fffd4b1ee8db None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:08.374575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31774066-9f9f-4d06-8b58-fffd4b1ee8db None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:08.374847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31774066-9f9f-4d06-8b58-fffd4b1ee8db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:08.384943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31774066-9f9f-4d06-8b58-fffd4b1ee8db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-31774066-9f9f-4d06-8b58-fffd4b1ee8db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:08:08.389655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:08.390781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:08.391690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 630/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:08.396903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742694dc-d139-4819-b020-088c244493a8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:08.414846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:08.493775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742694dc-d139-4819-b020-088c244493a8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:08.527606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:08.528465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:08.528944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:08.529855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:08.530529 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:08.530836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:08.532216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:08.540353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 634/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:08.546296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31774066-9f9f-4d06-8b58-fffd4b1ee8db None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:08.613176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:08.645900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31774066-9f9f-4d06-8b58-fffd4b1ee8db None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:08.678327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:08.678943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:08.679216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:08.679528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:08.689903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:08.691430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:08:08.705776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:08.709346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:08:08.710484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:08:08.710484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:08.710484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:08.710484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 631/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:08.712921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:08.793948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:08.812366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3115aea-9f70-43ae-8192-d85b8a6034bb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:08.847482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:08.848097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:08.848404 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:08.848697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:08.849333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:08.849629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:08.850968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:08.862669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 635/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:08:08.869429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:08.967888 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a5133-34d8-4f72-9194-2fde9fb700ed None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:08.987441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:09.001650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:09.001974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:09.002251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:09.002521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:09.009874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:09.011436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:08:09.022205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:09.023277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:09.024675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 632/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:09.029636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:09.129668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d01804-6098-48d5-84ca-6047a474d410 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:09.162371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:09.162978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:09.163261 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:09.163535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:09.164292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:09.164626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:09.166572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:09.175381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:09.183853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 636/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 11:08:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:09.189709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:09.288502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63d1b8-f1bf-4633-b841-bbf96965db8b None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:09.321086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:09.321696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:09.321980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:09.322245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:09.332207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:09.333732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:08:09.347491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:09.348548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:08:09.350051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:08:09.350051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:09.350051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:09.350051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 633/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:09.354917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:09.453460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c1618-84b4-4956-ae8f-84dca66d4377 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:09.488044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:09.488689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:09.488967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:09.489236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:09.489872 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:09.490172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:09.491513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:09.502764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 637/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:09.508243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:09.541300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:09.606992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c4ff4-a40b-484f-9cf5-00c9b18a6d78 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:09.640820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:09.641453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:09.641734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:09.642005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:09.648731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:09.650746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:08:09.662243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:09.665622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:09.666778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 634/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:09.670369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:09.728627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:09.770465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233de99-3133-4c54-9d8c-be9bf3d50656 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:09.804014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9237cc-8cf0-4b33-926f-a385c08b2419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:09.804585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9237cc-8cf0-4b33-926f-a385c08b2419 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:09.804867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9237cc-8cf0-4b33-926f-a385c08b2419 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:09.805141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9237cc-8cf0-4b33-926f-a385c08b2419 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:09.806142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9237cc-8cf0-4b33-926f-a385c08b2419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:09.806448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9237cc-8cf0-4b33-926f-a385c08b2419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:09.807918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9237cc-8cf0-4b33-926f-a385c08b2419 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:09.826039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 638/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:09.827042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:09.919424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:09.927903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cdfdd-0ae0-43be-9067-a3a6496342c2 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:09.960619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb9641-9cff-466a-913e-b1d7838be2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:09.961283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9641-9cff-466a-913e-b1d7838be2ec None admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:09.961633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9641-9cff-466a-913e-b1d7838be2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:09.961909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb9641-9cff-466a-913e-b1d7838be2ec None admin] PATH_INFO: `/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/84db64968844438b96d04172cfd0e925/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:09.963852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb9641-9cff-466a-913e-b1d7838be2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f27fafd5a45ca9bbf07495fbcbe36, user_id=84db64968844438b96d04172cfd0e925, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:09.965305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb9641-9cff-466a-913e-b1d7838be2ec None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:10.054778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 635/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 10 11:08:09 2022] PUT /identity/v3/projects/8f1f27fafd5a45ca9bbf07495fbcbe36/users/84db64968844438b96d04172cfd0e925/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:08:12.022685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4756-b8b9-4426-8eaa-aa93df8cdd1c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:12.023570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4756-b8b9-4426-8eaa-aa93df8cdd1c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:12.023570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4756-b8b9-4426-8eaa-aa93df8cdd1c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:12.025451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 639/1274] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:12.030607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3c10-e9a3-47c8-8b52-5d0c435b332c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:12.031074 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3c10-e9a3-47c8-8b52-5d0c435b332c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:12.031176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3c10-e9a3-47c8-8b52-5d0c435b332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:12.049152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a38f3c10-e9a3-47c8-8b52-5d0c435b332c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:12.050331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a38f3c10-e9a3-47c8-8b52-5d0c435b332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:12.115413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 636/1275] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:08:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:08:12.139608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4756-b8b9-4426-8eaa-aa93df8cdd1c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:12.240729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4756-b8b9-4426-8eaa-aa93df8cdd1c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:12.259859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:12.276846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c68e9-2777-4b79-8133-6a584795dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:12.279103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c68e9-2777-4b79-8133-6a584795dca3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:12.279103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c68e9-2777-4b79-8133-6a584795dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:12.279103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c68e9-2777-4b79-8133-6a584795dca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:12.287638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c68e9-2777-4b79-8133-6a584795dca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7b5c68e9-2777-4b79-8133-6a584795dca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 11:08:12.292231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:12.293541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:12.294643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 640/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 10 11:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 11:08:12.299443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3c10-e9a3-47c8-8b52-5d0c435b332c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:12.379229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:12.396871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3c10-e9a3-47c8-8b52-5d0c435b332c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:12.429559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:12.431005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:12.431489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:12.431820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:12.432628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:12.433523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:12.434735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:12.442500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 637/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 10 11:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:12.448984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c68e9-2777-4b79-8133-6a584795dca3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:12.546964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c68e9-2777-4b79-8133-6a584795dca3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:12.580266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:12.580909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:12.581185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:12.581453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:12.591761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:12.593245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:08:12.606583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:12.607781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:08:12.608963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:08:12.608963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:12.608963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:12.608963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 641/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:12.613540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:12.714232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20561268-bdbb-4565-8122-570e4fddc99f None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:12.747656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:12.748267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:12.748572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:12.748869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:12.749473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:12.749811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:12.751157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:12.762710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 638/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:12.768470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:12.799453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:12.866925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c484b6e-8af5-49bf-9cd2-c90a38b4aeed None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:12.901392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:12.902047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:12.902323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:12.902595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:12.909342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:12.910744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 11:08:12.922179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:12.923351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:12.924779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 642/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:12.929169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:12.933608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:13.025864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56b28c-cd13-4086-a1eb-b0528923c0f3 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:13.058643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:13.059267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:13.059519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:13.059792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:13.060553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:13.060859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:13.062290 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:13.079669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 639/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 10 11:08:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:13.085483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:13.175663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:13.185077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031248d-5fb1-40e4-9cdd-40845a1f818e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:13.218001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7624255-b055-4629-ac78-15f4e96d20ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:13.218635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624255-b055-4629-ac78-15f4e96d20ff None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:13.218916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624255-b055-4629-ac78-15f4e96d20ff None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:13.219186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624255-b055-4629-ac78-15f4e96d20ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:13.284633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7624255-b055-4629-ac78-15f4e96d20ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:13.286009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7624255-b055-4629-ac78-15f4e96d20ff None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:13.372742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:13.382715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 643/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 10 11:08:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 11:08:13.388735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:13.449967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:13.488082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5a651-2ffc-4c6a-a191-29a393525361 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:13.520903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:13.521559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:13.521835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:13.522107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:13.533343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:13.534818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 11:08:13.548622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:13.549746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 11:08:13.550843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 11:08:13.550843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 11:08:13.550843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:13.550843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 640/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:13.555817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7624255-b055-4629-ac78-15f4e96d20ff None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:13.652860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7624255-b055-4629-ac78-15f4e96d20ff None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:13.685594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:13.686201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:13.686485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:13.686760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:13.687405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:13.687709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:13.689098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:13.700497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 644/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 10 11:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:13.706121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:13.807973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6577a97-1c94-4d87-a1d1-8c23471ff7c0 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:13.821835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:13.842249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:13.842870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:13.843147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:13.843417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:13.849609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:13.851078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 11:08:13.861961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:13.865408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: ERROR keystone.server.flask.application Aug 10 11:08:13.866536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 641/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 10 11:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:13.869583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:13.918790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:13.966873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7f35f-8783-4daf-8d66-15bedaafb2d1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:13.999818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b393572-efef-4207-abae-41a42dbb7c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:14.000494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b393572-efef-4207-abae-41a42dbb7c32 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:14.000772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b393572-efef-4207-abae-41a42dbb7c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:14.001042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b393572-efef-4207-abae-41a42dbb7c32 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:14.001729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b393572-efef-4207-abae-41a42dbb7c32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:14.002028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b393572-efef-4207-abae-41a42dbb7c32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:14.003464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b393572-efef-4207-abae-41a42dbb7c32 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:14.015747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 645/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 10 11:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:14.021929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:14.118192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f103a9f-19af-4fdb-8678-962356a0a083 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:14.150779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab44ce-1afc-43b9-b74e-457ccdc4f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:14.151370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab44ce-1afc-43b9-b74e-457ccdc4f981 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:14.151649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab44ce-1afc-43b9-b74e-457ccdc4f981 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:14.151919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab44ce-1afc-43b9-b74e-457ccdc4f981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:14.152669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab44ce-1afc-43b9-b74e-457ccdc4f981 None admin] RBAC: Adding query filter params (role.id=b5150972b0fa4b60a278cc67fd0ce6e8, scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36, user.id=84db64968844438b96d04172cfd0e925) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:14.152974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab44ce-1afc-43b9-b74e-457ccdc4f981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:14.154396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab44ce-1afc-43b9-b74e-457ccdc4f981 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:14.159895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 642/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 10 11:08:14 2022] GET /identity/v3/role_assignments?user.id=84db64968844438b96d04172cfd0e925&scope.project.id=8f1f27fafd5a45ca9bbf07495fbcbe36&role.id=b5150972b0fa4b60a278cc67fd0ce6e8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:16.269035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fd43d-ceff-4eb9-9d4d-fcfeff96b418 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:16.269641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fd43d-ceff-4eb9-9d4d-fcfeff96b418 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:16.269641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fd43d-ceff-4eb9-9d4d-fcfeff96b418 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:16.270974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 646/1288] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:16.276488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6873-a839-4741-885a-29478769c4a4 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:16.276872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6873-a839-4741-885a-29478769c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:16.278098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6873-a839-4741-885a-29478769c4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:16.294766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-523a6873-a839-4741-885a-29478769c4a4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:16.295933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-523a6873-a839-4741-885a-29478769c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:16.325683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:16.362256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 643/1289] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:08:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:08:16.385277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fd43d-ceff-4eb9-9d4d-fcfeff96b418 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:16.483599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fd43d-ceff-4eb9-9d4d-fcfeff96b418 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:16.494678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:16.516594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:16.517213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:16.517488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:16.517757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:16.518325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:16.524813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:16.528223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:16.529493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:16.530717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 647/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:08:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:16.535574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a6873-a839-4741-885a-29478769c4a4 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:16.632384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a6873-a839-4741-885a-29478769c4a4 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:16.667073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68c367-2361-4d31-b8e2-f93d480ca7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:16.667681 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68c367-2361-4d31-b8e2-f93d480ca7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:16.667962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68c367-2361-4d31-b8e2-f93d480ca7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:16.668236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68c367-2361-4d31-b8e2-f93d480ca7c7 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:16.668897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68c367-2361-4d31-b8e2-f93d480ca7c7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:16.669201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68c367-2361-4d31-b8e2-f93d480ca7c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:16.670598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68c367-2361-4d31-b8e2-f93d480ca7c7 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:16.675245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 644/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 10 11:08:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:16.681128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:16.779830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385f0e7-5e96-4b7d-b62c-6ffbd0084ef9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:16.811939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fcba3-7a95-4c86-8780-0284f6293316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:16.812581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fcba3-7a95-4c86-8780-0284f6293316 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:16.812866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fcba3-7a95-4c86-8780-0284f6293316 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:16.813139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fcba3-7a95-4c86-8780-0284f6293316 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:16.813777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fcba3-7a95-4c86-8780-0284f6293316 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:16.814083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fcba3-7a95-4c86-8780-0284f6293316 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:16.815465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fcba3-7a95-4c86-8780-0284f6293316 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:16.820872 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 648/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 10 11:08:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:18.796503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fb6a-51d9-4156-bbf7-7c58af3f1cb0 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:18.797086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fb6a-51d9-4156-bbf7-7c58af3f1cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:18.797086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fb6a-51d9-4156-bbf7-7c58af3f1cb0 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:18.798401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 645/1293] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:18.803619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cc83-8b4b-4f9e-b126-eaf689d2d099 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:18.804034 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cc83-8b4b-4f9e-b126-eaf689d2d099 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:18.804166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cc83-8b4b-4f9e-b126-eaf689d2d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:18.822267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7a14cc83-8b4b-4f9e-b126-eaf689d2d099 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:18.823429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7a14cc83-8b4b-4f9e-b126-eaf689d2d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:18.853066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:18.889461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 649/1294] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:08:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:08:18.912592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23fb6a-51d9-4156-bbf7-7c58af3f1cb0 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:18.943526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:19.012252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23fb6a-51d9-4156-bbf7-7c58af3f1cb0 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:19.045474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3c9eb-da91-4a7e-94ab-02b62738d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:19.046082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c9eb-da91-4a7e-94ab-02b62738d65b None admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:19.046367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c9eb-da91-4a7e-94ab-02b62738d65b None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:19.046690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3c9eb-da91-4a7e-94ab-02b62738d65b None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:19.047358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3c9eb-da91-4a7e-94ab-02b62738d65b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:19.048755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3c9eb-da91-4a7e-94ab-02b62738d65b None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:19.110749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 646/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 10 11:08:18 2022] POST /identity/v3/services => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:08:21.174931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d693-d3f5-4c83-b123-cde77f9d667c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:21.175451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d693-d3f5-4c83-b123-cde77f9d667c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:21.175451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d693-d3f5-4c83-b123-cde77f9d667c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:21.176830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 650/1296] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:21.182658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aa10f-a627-4558-8b73-5ae133a9f17f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:21.183094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aa10f-a627-4558-8b73-5ae133a9f17f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:21.183212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aa10f-a627-4558-8b73-5ae133a9f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:21.200873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-950aa10f-a627-4558-8b73-5ae133a9f17f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:21.202036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-950aa10f-a627-4558-8b73-5ae133a9f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:21.271772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 647/1297] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:08:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:08:21.295755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3d693-d3f5-4c83-b123-cde77f9d667c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:21.396667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3d693-d3f5-4c83-b123-cde77f9d667c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:21.430986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:21.431552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:21.431834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:21.432104 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:21.432713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:21.434066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:21.442453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:21.443701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:21.445646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 651/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:08:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:21.450195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950aa10f-a627-4558-8b73-5ae133a9f17f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:21.468194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:21.546384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950aa10f-a627-4558-8b73-5ae133a9f17f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:21.579069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:21.579671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:21.579950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:21.580220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:21.580878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:21.581176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:21.582533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:21.587549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 648/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 10 11:08:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:21.593523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:21.624863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:21.689975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f10ad-27f2-486b-a22e-e05442c10281 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:21.723367 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56850b6-f59a-4b46-85bc-b00c0a299e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:21.723969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56850b6-f59a-4b46-85bc-b00c0a299e4f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:21.724249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56850b6-f59a-4b46-85bc-b00c0a299e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:21.724553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56850b6-f59a-4b46-85bc-b00c0a299e4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:21.725260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56850b6-f59a-4b46-85bc-b00c0a299e4f None admin] RBAC: Adding query filter params (interface=public, service_id=029f08ac7a6f42cc9ca2730c230cbcf6, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:21.725568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56850b6-f59a-4b46-85bc-b00c0a299e4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:21.727545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56850b6-f59a-4b46-85bc-b00c0a299e4f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:21.732596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 652/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 10 11:08:21 2022] GET /identity/v3/endpoints?service_id=029f08ac7a6f42cc9ca2730c230cbcf6&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:21.738278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:21.819575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:21.837042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff88a6-b95e-4669-9508-348ef2b76c21 None admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:21.870895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3689c-3274-4994-9db7-715f2c056de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:21.871494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3689c-3274-4994-9db7-715f2c056de0 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:21.871772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3689c-3274-4994-9db7-715f2c056de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:21.872046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3689c-3274-4994-9db7-715f2c056de0 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:21.872673 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3689c-3274-4994-9db7-715f2c056de0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:21.874029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3689c-3274-4994-9db7-715f2c056de0 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:21.880532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 649/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 10 11:08:21 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:08:23.891019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32759-6331-4f35-b000-e14c2d080477 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:23.891534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32759-6331-4f35-b000-e14c2d080477 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:23.891636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32759-6331-4f35-b000-e14c2d080477 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:23.893008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 653/1302] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:08:23.898439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bffddc-50cf-4377-a4f4-f2cecd96c5f6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:23.898883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bffddc-50cf-4377-a4f4-f2cecd96c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:23.898988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bffddc-50cf-4377-a4f4-f2cecd96c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:23.916527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-06bffddc-50cf-4377-a4f4-f2cecd96c5f6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:08:23.917687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-06bffddc-50cf-4377-a4f4-f2cecd96c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:08:23.981680 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 650/1303] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:08:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 11:08:24.004896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b32759-6331-4f35-b000-e14c2d080477 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:24.098344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:24.105466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b32759-6331-4f35-b000-e14c2d080477 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:24.138110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:24.139046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:24.139491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:24.140083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:24.140704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:24.142219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 11:08:24.150890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 11:08:24.152114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Aug 10 11:08:24.153179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 654/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 10 11:08:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 11:08:24.157991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bffddc-50cf-4377-a4f4-f2cecd96c5f6 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:24.232823 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:24.255399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bffddc-50cf-4377-a4f4-f2cecd96c5f6 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:24.290376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf20300-a3e4-4ab9-bb61-34a4d628c121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:24.290998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20300-a3e4-4ab9-bb61-34a4d628c121 None admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:24.291278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20300-a3e4-4ab9-bb61-34a4d628c121 None admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:24.291541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf20300-a3e4-4ab9-bb61-34a4d628c121 None admin] PATH_INFO: `/v3/services` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:24.292156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf20300-a3e4-4ab9-bb61-34a4d628c121 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:08:24.292481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf20300-a3e4-4ab9-bb61-34a4d628c121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:24.293843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf20300-a3e4-4ab9-bb61-34a4d628c121 None admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:24.298785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 651/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 10 11:08:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:08:24.305802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:08:24.404419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bd6ec-704e-40c5-a430-5a0262623067 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:08:24.436137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891693-369a-4da5-95d9-4f4f47bfa240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:08:24.436763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891693-369a-4da5-95d9-4f4f47bfa240 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:08:24.437042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891693-369a-4da5-95d9-4f4f47bfa240 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:08:24.437311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891693-369a-4da5-95d9-4f4f47bfa240 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:08:24.437953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891693-369a-4da5-95d9-4f4f47bfa240 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:08:24.439343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891693-369a-4da5-95d9-4f4f47bfa240 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:08:24.539951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 655/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:08:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:08:34.295810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=30 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:08:34.534477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:28.714630 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de199c69-eb38-435c-9efb-9090aa8e6b97 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:28.715270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de199c69-eb38-435c-9efb-9090aa8e6b97 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:28.715270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de199c69-eb38-435c-9efb-9090aa8e6b97 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:28.722470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8ed0-ccfe-4dbc-93f2-cd8110886125 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:28.725741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8ed0-ccfe-4dbc-93f2-cd8110886125 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:28.725741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e8ed0-ccfe-4dbc-93f2-cd8110886125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:28.728135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 652/1307] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:28 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:28.814786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fd7e8ed0-ccfe-4dbc-93f2-cd8110886125 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:28.816348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fd7e8ed0-ccfe-4dbc-93f2-cd8110886125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:28.944707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 656/1308] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:14:28.983204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9b6d1-b66f-423d-8ada-d94ad2c929ff None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:28.986056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9b6d1-b66f-423d-8ada-d94ad2c929ff None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:28.986056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9b6d1-b66f-423d-8ada-d94ad2c929ff None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:28.986056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 653/1309] 10.222.0.40 () {54 vars in 965 bytes} [Wed Aug 10 11:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:28.993710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6dee-a950-409c-9d37-506575328bad None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:28.993999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6dee-a950-409c-9d37-506575328bad None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:28.994280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6dee-a950-409c-9d37-506575328bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:29.089229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-011e6dee-a950-409c-9d37-506575328bad None None] MFA Rules not processed for user `512aab5a19c94651bfa0f634244dbdab`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:29.091888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-011e6dee-a950-409c-9d37-506575328bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:29.131216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:29.200683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9b6d1-b66f-423d-8ada-d94ad2c929ff None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:29.202436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-92f9b6d1-b66f-423d-8ada-d94ad2c929ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:29.211775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 657/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Aug 10 11:14:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:29.323659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9b6d1-b66f-423d-8ada-d94ad2c929ff None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:29.399997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59727d-f317-41a3-a99c-62c4ee5d342c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:29.400644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59727d-f317-41a3-a99c-62c4ee5d342c service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:29.400926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59727d-f317-41a3-a99c-62c4ee5d342c service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:29.401199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59727d-f317-41a3-a99c-62c4ee5d342c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:29.402928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7c59727d-f317-41a3-a99c-62c4ee5d342c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:29.462424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:29.519658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59727d-f317-41a3-a99c-62c4ee5d342c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:29.521122 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59727d-f317-41a3-a99c-62c4ee5d342c service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:29.541945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 654/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:14:31.864356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c579-34c7-402b-9a49-3fbd30fa5920 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:31.864871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c579-34c7-402b-9a49-3fbd30fa5920 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:31.864965 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c579-34c7-402b-9a49-3fbd30fa5920 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:31.866383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 658/1312] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:31.871216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432391e-fbbc-4124-9bd5-c1390772c0b7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:31.871628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432391e-fbbc-4124-9bd5-c1390772c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:31.871759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432391e-fbbc-4124-9bd5-c1390772c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:31.943427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5432391e-fbbc-4124-9bd5-c1390772c0b7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:31.944658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5432391e-fbbc-4124-9bd5-c1390772c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:32.040351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 655/1313] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:32.092192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc65a1-2f65-4770-a3fb-bc0dc7946157 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:32.092508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc65a1-2f65-4770-a3fb-bc0dc7946157 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:32.092851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc65a1-2f65-4770-a3fb-bc0dc7946157 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:32.094247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 659/1314] 10.222.0.40 () {54 vars in 965 bytes} [Wed Aug 10 11:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:32.100867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b928-7c59-4e93-9ebc-bb28f30fc143 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:32.101147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b928-7c59-4e93-9ebc-bb28f30fc143 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:32.101417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752b928-7c59-4e93-9ebc-bb28f30fc143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:32.113660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:32.183527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e752b928-7c59-4e93-9ebc-bb28f30fc143 None None] MFA Rules not processed for user `512aab5a19c94651bfa0f634244dbdab`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:32.184824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e752b928-7c59-4e93-9ebc-bb28f30fc143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:32.260977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 656/1315] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Aug 10 11:14:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:32.270295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc65a1-2f65-4770-a3fb-bc0dc7946157 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:32.271821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1edc65a1-2f65-4770-a3fb-bc0dc7946157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:32.375217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc65a1-2f65-4770-a3fb-bc0dc7946157 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:32.446543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:32.449244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dad98d-86d4-4610-95d7-a084feb80995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:32.449985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad98d-86d4-4610-95d7-a084feb80995 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:32.450129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad98d-86d4-4610-95d7-a084feb80995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:32.450400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad98d-86d4-4610-95d7-a084feb80995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:32.451982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e4dad98d-86d4-4610-95d7-a084feb80995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:32.563473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad98d-86d4-4610-95d7-a084feb80995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:32.564930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad98d-86d4-4610-95d7-a084feb80995 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:32.583190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 660/1316] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:35.358178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94577-490d-46f6-968e-a4a8a6f22429 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:35.358702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94577-490d-46f6-968e-a4a8a6f22429 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:35.358702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e94577-490d-46f6-968e-a4a8a6f22429 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:35.360041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 657/1317] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:35.365410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c617c0-5243-4df4-b6c2-0c57de3f122e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:35.365822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c617c0-5243-4df4-b6c2-0c57de3f122e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:35.365956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c617c0-5243-4df4-b6c2-0c57de3f122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:35.430731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d8c617c0-5243-4df4-b6c2-0c57de3f122e None None] MFA Rules not processed for user `5c85fe8a38f6491ebff4972f42b84145`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:35.431919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d8c617c0-5243-4df4-b6c2-0c57de3f122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:35.482570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:35.526058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 661/1318] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:35.568954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e94577-490d-46f6-968e-a4a8a6f22429 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:35.570462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d2e94577-490d-46f6-968e-a4a8a6f22429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:35.671886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e94577-490d-46f6-968e-a4a8a6f22429 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:35.674728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:35.744082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913feeab-0966-44be-9e98-cfefec860586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:35.744712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913feeab-0966-44be-9e98-cfefec860586 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:35.744991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913feeab-0966-44be-9e98-cfefec860586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:35.745261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913feeab-0966-44be-9e98-cfefec860586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:35.746846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-913feeab-0966-44be-9e98-cfefec860586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:35.852878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913feeab-0966-44be-9e98-cfefec860586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:35.854314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913feeab-0966-44be-9e98-cfefec860586 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:35.872508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 658/1319] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:38.633372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e5978-7d2e-4bc2-bb17-4ab293183f69 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:38.633932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e5978-7d2e-4bc2-bb17-4ab293183f69 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:38.633932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e5978-7d2e-4bc2-bb17-4ab293183f69 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:38.635229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 662/1320] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:38.640286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302599-1002-4bea-9724-027a57a02502 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:38.640709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302599-1002-4bea-9724-027a57a02502 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:38.640865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302599-1002-4bea-9724-027a57a02502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:38.682646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:38.708191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-31302599-1002-4bea-9724-027a57a02502 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:38.708191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-31302599-1002-4bea-9724-027a57a02502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:38.800611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 659/1321] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:38.838657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e5978-7d2e-4bc2-bb17-4ab293183f69 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:38.840171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-951e5978-7d2e-4bc2-bb17-4ab293183f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:38.940582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e5978-7d2e-4bc2-bb17-4ab293183f69 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:39.010700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c4182-f8b0-4039-acdc-732db870d23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:39.011232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4182-f8b0-4039-acdc-732db870d23c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:39.011506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4182-f8b0-4039-acdc-732db870d23c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:39.011774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c4182-f8b0-4039-acdc-732db870d23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:39.013465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1e4c4182-f8b0-4039-acdc-732db870d23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:39.021461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:39.118835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c4182-f8b0-4039-acdc-732db870d23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:39.120234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c4182-f8b0-4039-acdc-732db870d23c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:39.137425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 663/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:42.223972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a302f-e2b9-499a-bb49-d3dc13ba37b1 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:42.224595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a302f-e2b9-499a-bb49-d3dc13ba37b1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:42.224595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a302f-e2b9-499a-bb49-d3dc13ba37b1 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:42.226058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 660/1323] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:42.231012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726e00d-89eb-47c3-8406-9d5d1bc3e6f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:42.231397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726e00d-89eb-47c3-8406-9d5d1bc3e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:42.231692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726e00d-89eb-47c3-8406-9d5d1bc3e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:42.301550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6726e00d-89eb-47c3-8406-9d5d1bc3e6f4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:42.302748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6726e00d-89eb-47c3-8406-9d5d1bc3e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:42.362832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:42.406899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 664/1324] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:42.446100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a302f-e2b9-499a-bb49-d3dc13ba37b1 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:42.447684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-201a302f-e2b9-499a-bb49-d3dc13ba37b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:42.558137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a302f-e2b9-499a-bb49-d3dc13ba37b1 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:42.571390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:42.636544 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e96e1a-9c2f-4c96-9a12-d3981aecfb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:42.637168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96e1a-9c2f-4c96-9a12-d3981aecfb04 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:42.637447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96e1a-9c2f-4c96-9a12-d3981aecfb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:42.637717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96e1a-9c2f-4c96-9a12-d3981aecfb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:42.639359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-05e96e1a-9c2f-4c96-9a12-d3981aecfb04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:42.751519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96e1a-9c2f-4c96-9a12-d3981aecfb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:42.753605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96e1a-9c2f-4c96-9a12-d3981aecfb04 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:42.772329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 661/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:44.839028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150147a-a5f3-45aa-8457-a149f57464d8 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:44.839515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150147a-a5f3-45aa-8457-a149f57464d8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:44.839609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150147a-a5f3-45aa-8457-a149f57464d8 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:44.840945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 665/1326] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:44.846955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005936-b9bb-4d05-b8da-259b584e1d6f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:44.847386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005936-b9bb-4d05-b8da-259b584e1d6f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:44.847643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005936-b9bb-4d05-b8da-259b584e1d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:44.894877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:44.914607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a9005936-b9bb-4d05-b8da-259b584e1d6f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:44.923533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a9005936-b9bb-4d05-b8da-259b584e1d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:45.132955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 662/1327] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:45.170141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150147a-a5f3-45aa-8457-a149f57464d8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:45.171761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9150147a-a5f3-45aa-8457-a149f57464d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:45.279186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150147a-a5f3-45aa-8457-a149f57464d8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:45.354869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534031e-95a9-4a33-983d-fcdc85fd70c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:45.355479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534031e-95a9-4a33-983d-fcdc85fd70c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:45.355756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534031e-95a9-4a33-983d-fcdc85fd70c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:45.356025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534031e-95a9-4a33-983d-fcdc85fd70c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:45.357739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1534031e-95a9-4a33-983d-fcdc85fd70c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:45.374662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:45.467995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534031e-95a9-4a33-983d-fcdc85fd70c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:45.470036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534031e-95a9-4a33-983d-fcdc85fd70c8 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:45.489969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 666/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:47.571375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e02cfe-0c97-4c9a-84be-6297b03cd050 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:47.571913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e02cfe-0c97-4c9a-84be-6297b03cd050 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:47.571913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e02cfe-0c97-4c9a-84be-6297b03cd050 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:47.573284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 663/1329] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:47.578461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b800b3-b486-4ec2-a087-86a0a931ad78 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:47.578897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b800b3-b486-4ec2-a087-86a0a931ad78 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:47.579003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b800b3-b486-4ec2-a087-86a0a931ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:47.647654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-46b800b3-b486-4ec2-a087-86a0a931ad78 None None] MFA Rules not processed for user `5c85fe8a38f6491ebff4972f42b84145`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:47.648873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-46b800b3-b486-4ec2-a087-86a0a931ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:47.716599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:47.748481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 667/1330] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:47.787426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e02cfe-0c97-4c9a-84be-6297b03cd050 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:47.788966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-18e02cfe-0c97-4c9a-84be-6297b03cd050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:47.893388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e02cfe-0c97-4c9a-84be-6297b03cd050 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:47.914010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:47.967273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6ed93-58bf-48b4-8ec8-ae797c2850e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:47.967871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ed93-58bf-48b4-8ec8-ae797c2850e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:47.968145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ed93-58bf-48b4-8ec8-ae797c2850e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:47.968437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ed93-58bf-48b4-8ec8-ae797c2850e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:47.970004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7af6ed93-58bf-48b4-8ec8-ae797c2850e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:48.093298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6ed93-58bf-48b4-8ec8-ae797c2850e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:48.094777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6ed93-58bf-48b4-8ec8-ae797c2850e7 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:48.116242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 664/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:50.644984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d232704-1c35-4c20-a9f8-860ee1067abc None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:50.645458 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d232704-1c35-4c20-a9f8-860ee1067abc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:50.645605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d232704-1c35-4c20-a9f8-860ee1067abc None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:50.646976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 668/1332] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:50.652227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead76d0-823c-4d94-9481-ea9cc28c2b69 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:50.652708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead76d0-823c-4d94-9481-ea9cc28c2b69 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:50.652805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead76d0-823c-4d94-9481-ea9cc28c2b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:50.719248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:50.724244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8ead76d0-823c-4d94-9481-ea9cc28c2b69 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:50.725662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8ead76d0-823c-4d94-9481-ea9cc28c2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:50.830960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 665/1333] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:50.866757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d232704-1c35-4c20-a9f8-860ee1067abc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:50.868251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d232704-1c35-4c20-a9f8-860ee1067abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:50.974115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d232704-1c35-4c20-a9f8-860ee1067abc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:51.045120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e3a0-4a43-4324-a69e-7408ffcff20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:51.045726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e3a0-4a43-4324-a69e-7408ffcff20c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:51.046002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e3a0-4a43-4324-a69e-7408ffcff20c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:51.046268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e3a0-4a43-4324-a69e-7408ffcff20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:51.047870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1559e3a0-4a43-4324-a69e-7408ffcff20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:51.075229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:51.161436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559e3a0-4a43-4324-a69e-7408ffcff20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:51.162862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559e3a0-4a43-4324-a69e-7408ffcff20c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:51.181923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 669/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:53.303285 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314723f5-5933-4c0c-881d-8dc2660c32ed None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:53.303851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314723f5-5933-4c0c-881d-8dc2660c32ed None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:53.303851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314723f5-5933-4c0c-881d-8dc2660c32ed None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:53.305191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 666/1335] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:53.310370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc617ebf-b409-4871-b0ca-0e4d9e64c6bf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:53.310816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc617ebf-b409-4871-b0ca-0e4d9e64c6bf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:53.310920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc617ebf-b409-4871-b0ca-0e4d9e64c6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:53.374146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bc617ebf-b409-4871-b0ca-0e4d9e64c6bf None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:53.375325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bc617ebf-b409-4871-b0ca-0e4d9e64c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:53.447129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:53.473414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 670/1336] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:53.512994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314723f5-5933-4c0c-881d-8dc2660c32ed None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:53.514515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-314723f5-5933-4c0c-881d-8dc2660c32ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:53.615678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314723f5-5933-4c0c-881d-8dc2660c32ed None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:53.643489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:53.686311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eee39-de74-4656-a790-f3c65cfb99e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:53.686908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eee39-de74-4656-a790-f3c65cfb99e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:53.687183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eee39-de74-4656-a790-f3c65cfb99e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:53.687449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eee39-de74-4656-a790-f3c65cfb99e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:53.689532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9f8eee39-de74-4656-a790-f3c65cfb99e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:53.793440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8eee39-de74-4656-a790-f3c65cfb99e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:53.794866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8eee39-de74-4656-a790-f3c65cfb99e2 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:53.812489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 667/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:14:56.504863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6b7c-81be-4963-8ea8-9f5e551f853c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:56.505355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6b7c-81be-4963-8ea8-9f5e551f853c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:56.505478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6b7c-81be-4963-8ea8-9f5e551f853c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:56.506741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 671/1338] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:14:56.511808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e468-15fb-478d-ab03-d4c29bb29bc7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:56.512204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e468-15fb-478d-ab03-d4c29bb29bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:56.512388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728e468-15fb-478d-ab03-d4c29bb29bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:56.577073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c728e468-15fb-478d-ab03-d4c29bb29bc7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:14:56.578302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c728e468-15fb-478d-ab03-d4c29bb29bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:56.587475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:56.674546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 668/1339] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:14:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:14:56.711081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c6b7c-81be-4963-8ea8-9f5e551f853c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:14:56.712640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-688c6b7c-81be-4963-8ea8-9f5e551f853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:56.812559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c6b7c-81be-4963-8ea8-9f5e551f853c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:14:56.884781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f89d2-1fef-4ac2-84b6-ed33875a2d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:14:56.885390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f89d2-1fef-4ac2-84b6-ed33875a2d95 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:14:56.885669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f89d2-1fef-4ac2-84b6-ed33875a2d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:14:56.885944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f89d2-1fef-4ac2-84b6-ed33875a2d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:14:56.887525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-103f89d2-1fef-4ac2-84b6-ed33875a2d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:14:56.921735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:14:56.993291 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f89d2-1fef-4ac2-84b6-ed33875a2d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:14:56.994633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f89d2-1fef-4ac2-84b6-ed33875a2d95 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:14:57.012838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 672/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:14:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:01.237169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8752-29a9-4070-aba4-68904b9bc77c None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:01.237574 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8752-29a9-4070-aba4-68904b9bc77c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:01.237710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8752-29a9-4070-aba4-68904b9bc77c None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:01.239051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 669/1341] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:01.244260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da928481-7bee-4cc3-a069-b54dde0f98d0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:01.244726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da928481-7bee-4cc3-a069-b54dde0f98d0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:01.245021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da928481-7bee-4cc3-a069-b54dde0f98d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:01.311758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-da928481-7bee-4cc3-a069-b54dde0f98d0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:01.312975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-da928481-7bee-4cc3-a069-b54dde0f98d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:01.398656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:01.410248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 673/1342] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:01.449511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8752-29a9-4070-aba4-68904b9bc77c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:01.451013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-667a8752-29a9-4070-aba4-68904b9bc77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:01.551631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8752-29a9-4070-aba4-68904b9bc77c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:01.587915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:01.623046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6de7-8e93-4959-a8d9-e4365124feb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:01.623644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6de7-8e93-4959-a8d9-e4365124feb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:01.623922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6de7-8e93-4959-a8d9-e4365124feb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:01.624187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6de7-8e93-4959-a8d9-e4365124feb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:01.625763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-941a6de7-8e93-4959-a8d9-e4365124feb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:01.732965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a6de7-8e93-4959-a8d9-e4365124feb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:01.734303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a6de7-8e93-4959-a8d9-e4365124feb5 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:01.752644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 670/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:05.139603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5f83-3fcc-4954-a8bc-bf2b2de791e7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:05.140178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5f83-3fcc-4954-a8bc-bf2b2de791e7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:05.140178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5f83-3fcc-4954-a8bc-bf2b2de791e7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:05.141535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 674/1344] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:05.146693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891f9a-e35e-4a9e-81fe-4bcf6b5ef11b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:05.147140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891f9a-e35e-4a9e-81fe-4bcf6b5ef11b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:05.147239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891f9a-e35e-4a9e-81fe-4bcf6b5ef11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:05.216114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-15891f9a-e35e-4a9e-81fe-4bcf6b5ef11b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:05.217417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-15891f9a-e35e-4a9e-81fe-4bcf6b5ef11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:05.238886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:05.321349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 671/1345] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:05.360556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5f83-3fcc-4954-a8bc-bf2b2de791e7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:05.362283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-84cf5f83-3fcc-4954-a8bc-bf2b2de791e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:05.471360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5f83-3fcc-4954-a8bc-bf2b2de791e7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:05.547420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f85765-e841-42f2-bcd8-831dd444d12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:05.548043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85765-e841-42f2-bcd8-831dd444d12f service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:05.548336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85765-e841-42f2-bcd8-831dd444d12f service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:05.548624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85765-e841-42f2-bcd8-831dd444d12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:05.550536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-78f85765-e841-42f2-bcd8-831dd444d12f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:05.596618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:05.663075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f85765-e841-42f2-bcd8-831dd444d12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:05.664519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f85765-e841-42f2-bcd8-831dd444d12f service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:05.682835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 675/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:10.094983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1bb97-5e74-454d-9cbd-5598e169792b None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:10.095508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1bb97-5e74-454d-9cbd-5598e169792b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:10.095508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1bb97-5e74-454d-9cbd-5598e169792b None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:10.097515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 672/1347] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:10.102294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76525f66-8b7e-40cd-85dd-3111eefcb8e9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:10.102797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76525f66-8b7e-40cd-85dd-3111eefcb8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:10.102902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76525f66-8b7e-40cd-85dd-3111eefcb8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:10.171663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-76525f66-8b7e-40cd-85dd-3111eefcb8e9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:10.173529 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-76525f66-8b7e-40cd-85dd-3111eefcb8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:10.277602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:10.280260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 676/1348] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:10.319560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1bb97-5e74-454d-9cbd-5598e169792b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:10.321847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-abe1bb97-5e74-454d-9cbd-5598e169792b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:10.428793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1bb97-5e74-454d-9cbd-5598e169792b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:10.477762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:10.507861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169cc02-ba3d-4949-adbe-e41936cf5618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:10.508396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cc02-ba3d-4949-adbe-e41936cf5618 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:10.508679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cc02-ba3d-4949-adbe-e41936cf5618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:10.508952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169cc02-ba3d-4949-adbe-e41936cf5618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:10.510576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6169cc02-ba3d-4949-adbe-e41936cf5618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:10.623736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cc02-ba3d-4949-adbe-e41936cf5618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:10.625218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169cc02-ba3d-4949-adbe-e41936cf5618 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:10.644626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 673/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:15.558860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4bcc-4523-4143-aef1-2fe74fb0930c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:15.558860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4bcc-4523-4143-aef1-2fe74fb0930c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:15.558860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4bcc-4523-4143-aef1-2fe74fb0930c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:15.558860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 677/1350] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:15.560363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f64d15-e833-4122-bc3a-c2475298b530 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:15.560363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f64d15-e833-4122-bc3a-c2475298b530 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:15.560363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f64d15-e833-4122-bc3a-c2475298b530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:15.708088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-29f64d15-e833-4122-bc3a-c2475298b530 None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:15.708088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-29f64d15-e833-4122-bc3a-c2475298b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:15.740913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:15.827577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 674/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:15:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:19.893846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5aa2e-2fcc-4199-abc3-ea2088c93db4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:19.894399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5aa2e-2fcc-4199-abc3-ea2088c93db4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:19.894399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5aa2e-2fcc-4199-abc3-ea2088c93db4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:19.895767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 678/1352] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:19.900744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3104b07-63da-47c4-93eb-77ff41605db9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:19.901194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3104b07-63da-47c4-93eb-77ff41605db9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:19.901279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3104b07-63da-47c4-93eb-77ff41605db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:19.983134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a3104b07-63da-47c4-93eb-77ff41605db9 None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:19.984926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a3104b07-63da-47c4-93eb-77ff41605db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:20.084244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:20.124341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 675/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:15:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:21.547622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316beb5c-ef43-4de3-939e-11b0420d7743 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:21.548375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316beb5c-ef43-4de3-939e-11b0420d7743 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:21.548375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316beb5c-ef43-4de3-939e-11b0420d7743 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:21.549687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 679/1354] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:21.555405 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d736ad-97e5-42fd-a594-3a3d63768239 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:21.555887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d736ad-97e5-42fd-a594-3a3d63768239 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:21.555999 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d736ad-97e5-42fd-a594-3a3d63768239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:21.632917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e0d736ad-97e5-42fd-a594-3a3d63768239 None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:21.634100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e0d736ad-97e5-42fd-a594-3a3d63768239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:21.744528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 676/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:15:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:15:25.162029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e141f9-bddf-485e-94ff-24fd80a06ba1 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:25.162558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e141f9-bddf-485e-94ff-24fd80a06ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:25.162558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e141f9-bddf-485e-94ff-24fd80a06ba1 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:25.164342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 680/1356] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:25.170188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a180d-3b15-450b-812c-e242937067a7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:25.171301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a180d-3b15-450b-812c-e242937067a7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:25.172437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a180d-3b15-450b-812c-e242937067a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:25.215196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:25.251419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8b2a180d-3b15-450b-812c-e242937067a7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:25.252631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8b2a180d-3b15-450b-812c-e242937067a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:25.354605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 677/1357] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:25.409375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008dedd-71d6-4b31-8685-83f9b2674303 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:25.409967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008dedd-71d6-4b31-8685-83f9b2674303 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:25.410315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008dedd-71d6-4b31-8685-83f9b2674303 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:25.411720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 681/1358] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 10 11:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:25.422061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca860-6d7e-46fa-8f92-23879d03c9fa None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:25.422381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca860-6d7e-46fa-8f92-23879d03c9fa None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:25.422755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca860-6d7e-46fa-8f92-23879d03c9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:25.509222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a72ca860-6d7e-46fa-8f92-23879d03c9fa None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:25.510507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a72ca860-6d7e-46fa-8f92-23879d03c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:25.564327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:25.635018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 678/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 10 11:15:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:25.642817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008dedd-71d6-4b31-8685-83f9b2674303 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:25.644335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8008dedd-71d6-4b31-8685-83f9b2674303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:25.808251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008dedd-71d6-4b31-8685-83f9b2674303 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:25.901408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:25.947233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa61ac-1629-44fa-a401-dc12cc8bda8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:25.947959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa61ac-1629-44fa-a401-dc12cc8bda8d service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:25.948324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa61ac-1629-44fa-a401-dc12cc8bda8d service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:25.948706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa61ac-1629-44fa-a401-dc12cc8bda8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:25.950449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8eaa61ac-1629-44fa-a401-dc12cc8bda8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:26.045232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa61ac-1629-44fa-a401-dc12cc8bda8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:26.047438 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa61ac-1629-44fa-a401-dc12cc8bda8d service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:26.065673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 682/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:28.299551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375fbb4-4dff-4906-b6c6-cd5e9ea58ac0 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:28.300107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375fbb4-4dff-4906-b6c6-cd5e9ea58ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:28.300107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375fbb4-4dff-4906-b6c6-cd5e9ea58ac0 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:28.301606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 679/1361] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:28.307021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336f9e-cdb7-4404-a6d7-257ebd057538 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:28.307637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336f9e-cdb7-4404-a6d7-257ebd057538 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:28.307637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336f9e-cdb7-4404-a6d7-257ebd057538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:28.378383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d0336f9e-cdb7-4404-a6d7-257ebd057538 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:28.379678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d0336f9e-cdb7-4404-a6d7-257ebd057538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:28.420403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:28.484184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 683/1362] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:28.528866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375fbb4-4dff-4906-b6c6-cd5e9ea58ac0 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:28.531270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e375fbb4-4dff-4906-b6c6-cd5e9ea58ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:28.698834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375fbb4-4dff-4906-b6c6-cd5e9ea58ac0 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:28.709180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:28.826215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d304a5-c433-42b9-87cb-944e8903d4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:28.826879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d304a5-c433-42b9-87cb-944e8903d4ea service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:28.827230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d304a5-c433-42b9-87cb-944e8903d4ea service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:28.827230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d304a5-c433-42b9-87cb-944e8903d4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:28.829430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-07d304a5-c433-42b9-87cb-944e8903d4ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:28.928943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d304a5-c433-42b9-87cb-944e8903d4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:28.930623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d304a5-c433-42b9-87cb-944e8903d4ea service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:28.950640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 680/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:31.441218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1800f-5518-463f-aeca-8306d96fd727 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:31.441782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1800f-5518-463f-aeca-8306d96fd727 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:31.441782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1800f-5518-463f-aeca-8306d96fd727 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:31.443072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 684/1364] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:31.448333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e9fd3-b5c7-4ffd-af90-be2b22435f68 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:31.448756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e9fd3-b5c7-4ffd-af90-be2b22435f68 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:31.448889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e9fd3-b5c7-4ffd-af90-be2b22435f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:31.465354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:31.531715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-175e9fd3-b5c7-4ffd-af90-be2b22435f68 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:31.533007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-175e9fd3-b5c7-4ffd-af90-be2b22435f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:31.643078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 681/1365] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:31.696832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09ebf3-d7ca-4051-b1af-72d8dc906e50 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:31.697833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09ebf3-d7ca-4051-b1af-72d8dc906e50 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:31.698239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09ebf3-d7ca-4051-b1af-72d8dc906e50 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:31.699881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 685/1366] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 10 11:15:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:31.705463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5bfa7-93d9-4364-acb2-8bbba2675ca9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:31.712055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5bfa7-93d9-4364-acb2-8bbba2675ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:31.712055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5bfa7-93d9-4364-acb2-8bbba2675ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:31.788505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-1bd5bfa7-93d9-4364-acb2-8bbba2675ca9 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:31.789851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1bd5bfa7-93d9-4364-acb2-8bbba2675ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:31.834693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:31.926095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 682/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 10 11:15:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:31.934313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09ebf3-d7ca-4051-b1af-72d8dc906e50 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:31.935825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fc09ebf3-d7ca-4051-b1af-72d8dc906e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:32.096751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09ebf3-d7ca-4051-b1af-72d8dc906e50 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:32.117723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:32.214274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7e0d8-3386-428a-9a56-89ffcbf6e0ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:32.215049 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7e0d8-3386-428a-9a56-89ffcbf6e0ee service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:32.215277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7e0d8-3386-428a-9a56-89ffcbf6e0ee service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:32.215547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7e0d8-3386-428a-9a56-89ffcbf6e0ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:32.217174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fac7e0d8-3386-428a-9a56-89ffcbf6e0ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:32.314442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7e0d8-3386-428a-9a56-89ffcbf6e0ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:32.316164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7e0d8-3386-428a-9a56-89ffcbf6e0ee service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:32.334989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 686/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:33.307092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a9860-1966-4f59-8df3-3508a4ddc001 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:33.307643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a9860-1966-4f59-8df3-3508a4ddc001 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:33.307643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a9860-1966-4f59-8df3-3508a4ddc001 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:33.309014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 683/1369] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:33.314765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ce7df-dc37-4166-9fb8-bda0d695e6f8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:33.315219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ce7df-dc37-4166-9fb8-bda0d695e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:33.315709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ce7df-dc37-4166-9fb8-bda0d695e6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:33.349816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:33.385160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-660ce7df-dc37-4166-9fb8-bda0d695e6f8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:33.387636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-660ce7df-dc37-4166-9fb8-bda0d695e6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:33.492379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 687/1370] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:33.860686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb11e8d-b70f-48aa-a231-34d6cf3bde84 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:33.860967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb11e8d-b70f-48aa-a231-34d6cf3bde84 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:33.861237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb11e8d-b70f-48aa-a231-34d6cf3bde84 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:33.862734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 684/1371] 10.222.0.40 () {54 vars in 964 bytes} [Wed Aug 10 11:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:33.867496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cae87-f374-4bfa-bf69-8f556a75b059 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:33.868043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cae87-f374-4bfa-bf69-8f556a75b059 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:33.868615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cae87-f374-4bfa-bf69-8f556a75b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:33.959764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5e6cae87-f374-4bfa-bf69-8f556a75b059 None None] MFA Rules not processed for user `65afb6f35528480591f2411976470d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:33.961847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5e6cae87-f374-4bfa-bf69-8f556a75b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:34.017358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:34.050636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 688/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Aug 10 11:15:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:34.058193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb11e8d-b70f-48aa-a231-34d6cf3bde84 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:34.059920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ffb11e8d-b70f-48aa-a231-34d6cf3bde84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:34.170789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb11e8d-b70f-48aa-a231-34d6cf3bde84 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:34.211790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:34.249523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135a2e7-5a91-4458-a439-522f1c94b492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:34.250128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a2e7-5a91-4458-a439-522f1c94b492 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:34.250402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a2e7-5a91-4458-a439-522f1c94b492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:34.250668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135a2e7-5a91-4458-a439-522f1c94b492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:34.252243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d135a2e7-5a91-4458-a439-522f1c94b492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:34.371328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135a2e7-5a91-4458-a439-522f1c94b492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:34.372827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135a2e7-5a91-4458-a439-522f1c94b492 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:34.391847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 685/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:34.528019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcddbb-c2ff-4122-96d8-117880db0c5e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:34.528744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcddbb-c2ff-4122-96d8-117880db0c5e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:34.528744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcddbb-c2ff-4122-96d8-117880db0c5e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:34.530262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 689/1374] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:34.535337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6edee-9b3b-43ec-a93e-361c1c06c2e9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:34.535658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6edee-9b3b-43ec-a93e-361c1c06c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:34.535889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6edee-9b3b-43ec-a93e-361c1c06c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:34.605867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a8e6edee-9b3b-43ec-a93e-361c1c06c2e9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:34.607063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a8e6edee-9b3b-43ec-a93e-361c1c06c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:34.628937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:34.711494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 686/1375] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:34.755233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcddbb-c2ff-4122-96d8-117880db0c5e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:34.757490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-95fcddbb-c2ff-4122-96d8-117880db0c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:34.913067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcddbb-c2ff-4122-96d8-117880db0c5e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:34.963697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:35.025588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29755467-9fed-48d2-909a-30b2d44031c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:35.026267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29755467-9fed-48d2-909a-30b2d44031c1 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:35.026549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29755467-9fed-48d2-909a-30b2d44031c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:35.026819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29755467-9fed-48d2-909a-30b2d44031c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:35.028453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-29755467-9fed-48d2-909a-30b2d44031c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:35.119837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29755467-9fed-48d2-909a-30b2d44031c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:35.121457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29755467-9fed-48d2-909a-30b2d44031c1 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:35.140669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 690/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:37.297648 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51f26-86c3-4202-aa17-f22e476758d1 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:37.298147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51f26-86c3-4202-aa17-f22e476758d1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:37.298147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51f26-86c3-4202-aa17-f22e476758d1 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:37.299457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 687/1377] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:37.304807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f52b-41ef-4185-929f-f93590f3d1f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:37.305219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f52b-41ef-4185-929f-f93590f3d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:37.305354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6f52b-41ef-4185-929f-f93590f3d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:37.377024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5dc6f52b-41ef-4185-929f-f93590f3d1f4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:37.378272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5dc6f52b-41ef-4185-929f-f93590f3d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:37.384977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:37.478130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 691/1378] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:37.525453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b51f26-86c3-4202-aa17-f22e476758d1 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:37.526967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-71b51f26-86c3-4202-aa17-f22e476758d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:37.703459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b51f26-86c3-4202-aa17-f22e476758d1 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:37.706983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:37.814837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c5470-0dee-4948-8764-0082611907cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:37.815366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c5470-0dee-4948-8764-0082611907cc service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:37.815638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c5470-0dee-4948-8764-0082611907cc service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:37.815905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c5470-0dee-4948-8764-0082611907cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:37.817514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-859c5470-0dee-4948-8764-0082611907cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:37.909786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c5470-0dee-4948-8764-0082611907cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:37.911366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c5470-0dee-4948-8764-0082611907cc service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:37.929092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 688/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:40.146117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a819d23-425d-4902-a92c-2ccf2ddd222c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:40.146700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a819d23-425d-4902-a92c-2ccf2ddd222c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:40.146700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a819d23-425d-4902-a92c-2ccf2ddd222c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:40.148167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 692/1380] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:40.153212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa55f-5bba-4ca3-b748-d4d1ee7ce139 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:40.153651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa55f-5bba-4ca3-b748-d4d1ee7ce139 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:40.153866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa55f-5bba-4ca3-b748-d4d1ee7ce139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:40.165723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:40.222433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-eb1aa55f-5bba-4ca3-b748-d4d1ee7ce139 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:40.223641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-eb1aa55f-5bba-4ca3-b748-d4d1ee7ce139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:40.326024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 689/1381] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:40.370407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a819d23-425d-4902-a92c-2ccf2ddd222c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:40.372167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6a819d23-425d-4902-a92c-2ccf2ddd222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:40.538565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:40.549633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a819d23-425d-4902-a92c-2ccf2ddd222c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:40.674943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f27e34-5b5b-4b18-b5c2-33af3147360a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:40.675570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f27e34-5b5b-4b18-b5c2-33af3147360a service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:40.675921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f27e34-5b5b-4b18-b5c2-33af3147360a service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:40.676267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f27e34-5b5b-4b18-b5c2-33af3147360a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:40.677954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d8f27e34-5b5b-4b18-b5c2-33af3147360a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:40.776626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f27e34-5b5b-4b18-b5c2-33af3147360a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:40.778335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f27e34-5b5b-4b18-b5c2-33af3147360a service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:40.789806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:40.799044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 693/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:43.182401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021e61-0b2d-4d2a-ab86-02de923f9fb8 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.182947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021e61-0b2d-4d2a-ab86-02de923f9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.182947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021e61-0b2d-4d2a-ab86-02de923f9fb8 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.184385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 690/1383] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:43.190090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897172-81e0-4c6d-9e23-d74f9c7f719d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.190659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897172-81e0-4c6d-9e23-d74f9c7f719d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.190659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897172-81e0-4c6d-9e23-d74f9c7f719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.264612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-92897172-81e0-4c6d-9e23-d74f9c7f719d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:43.266076 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-92897172-81e0-4c6d-9e23-d74f9c7f719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:43.375087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 694/1384] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:43.418310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021e61-0b2d-4d2a-ab86-02de923f9fb8 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:43.419974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ec021e61-0b2d-4d2a-ab86-02de923f9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:43.503992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:43.566468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021e61-0b2d-4d2a-ab86-02de923f9fb8 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:43.684076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0e3f-15b1-449a-b811-abf12aadce7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:43.684738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0e3f-15b1-449a-b811-abf12aadce7a service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:43.685027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0e3f-15b1-449a-b811-abf12aadce7a service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:43.685295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0e3f-15b1-449a-b811-abf12aadce7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:43.686965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8dde0e3f-15b1-449a-b811-abf12aadce7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:43.737570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:43.780462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde0e3f-15b1-449a-b811-abf12aadce7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:43.783011 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde0e3f-15b1-449a-b811-abf12aadce7a service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:43.801746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 691/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:45.842450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5b51-c6b7-4eb3-b3b1-91be411b78b2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:45.843058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5b51-c6b7-4eb3-b3b1-91be411b78b2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:45.843058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5b51-c6b7-4eb3-b3b1-91be411b78b2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:45.844383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 695/1386] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:45.849823 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c52d1-aab2-4cfc-976a-9a2a95cff90a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:45.850460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c52d1-aab2-4cfc-976a-9a2a95cff90a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:45.850460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c52d1-aab2-4cfc-976a-9a2a95cff90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:45.919662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-bc5c52d1-aab2-4cfc-976a-9a2a95cff90a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:45.920959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-bc5c52d1-aab2-4cfc-976a-9a2a95cff90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:46.020763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 692/1387] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:15:46.066915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c5b51-c6b7-4eb3-b3b1-91be411b78b2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:46.068526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-264c5b51-c6b7-4eb3-b3b1-91be411b78b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:46.149925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:46.342699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c5b51-c6b7-4eb3-b3b1-91be411b78b2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:46.469280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad99c3-9fd5-4a6c-948c-2df1e5010c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:46.469811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad99c3-9fd5-4a6c-948c-2df1e5010c0f service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:46.470086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad99c3-9fd5-4a6c-948c-2df1e5010c0f service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:46.470353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad99c3-9fd5-4a6c-948c-2df1e5010c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:46.471967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5aad99c3-9fd5-4a6c-948c-2df1e5010c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:46.513736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:46.567506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad99c3-9fd5-4a6c-948c-2df1e5010c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:46.569204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad99c3-9fd5-4a6c-948c-2df1e5010c0f service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:46.591823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 696/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:48.920399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7ebb-1d66-4640-8fc0-252501c1b3f2 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:48.920934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7ebb-1d66-4640-8fc0-252501c1b3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:48.920934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7ebb-1d66-4640-8fc0-252501c1b3f2 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:48.922800 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 693/1389] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:48.928091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caeb9f-9eb4-4e02-b553-8a1f75c63f7e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:48.928554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caeb9f-9eb4-4e02-b553-8a1f75c63f7e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:48.928660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caeb9f-9eb4-4e02-b553-8a1f75c63f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:48.992643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-16caeb9f-9eb4-4e02-b553-8a1f75c63f7e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:48.993834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16caeb9f-9eb4-4e02-b553-8a1f75c63f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:49.092671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 697/1390] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:49.136379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7ebb-1d66-4640-8fc0-252501c1b3f2 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:49.137872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-925f7ebb-1d66-4640-8fc0-252501c1b3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:49.169845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:49.282881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7ebb-1d66-4640-8fc0-252501c1b3f2 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:49.383188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:49.396064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258425d-0948-4eb6-8ff0-1e4bf1b822ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:49.396701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258425d-0948-4eb6-8ff0-1e4bf1b822ec service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:49.396979 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258425d-0948-4eb6-8ff0-1e4bf1b822ec service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:49.397248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258425d-0948-4eb6-8ff0-1e4bf1b822ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:49.398858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5258425d-0948-4eb6-8ff0-1e4bf1b822ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:49.489207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258425d-0948-4eb6-8ff0-1e4bf1b822ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:49.490798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258425d-0948-4eb6-8ff0-1e4bf1b822ec service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:49.509005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 694/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:49.981602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dd7cd-0c40-41fd-8ef2-3404e56e5120 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:49.982132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dd7cd-0c40-41fd-8ef2-3404e56e5120 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:49.982132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dd7cd-0c40-41fd-8ef2-3404e56e5120 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:49.983457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 698/1392] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:49.988826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ecdf-77c4-4093-9e30-4c75c28938c1 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:49.989250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ecdf-77c4-4093-9e30-4c75c28938c1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:49.989400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7ecdf-77c4-4093-9e30-4c75c28938c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:50.055555 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-71f7ecdf-77c4-4093-9e30-4c75c28938c1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:50.056782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-71f7ecdf-77c4-4093-9e30-4c75c28938c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:50.116445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:50.155182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 695/1393] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:50.211247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f1ff-bd06-4819-b1eb-941647ad1a28 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:50.211535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f1ff-bd06-4819-b1eb-941647ad1a28 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:50.211811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f1ff-bd06-4819-b1eb-941647ad1a28 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:50.213166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 699/1394] 10.222.0.40 () {54 vars in 967 bytes} [Wed Aug 10 11:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:50.219064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1a32-b80b-4751-acb6-ce517c921cb9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:50.219368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1a32-b80b-4751-acb6-ce517c921cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:50.219644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1a32-b80b-4751-acb6-ce517c921cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:50.297651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a74f1a32-b80b-4751-acb6-ce517c921cb9 None None] MFA Rules not processed for user `fcc7327f524a450e8429b5008166e5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:50.298797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a74f1a32-b80b-4751-acb6-ce517c921cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:50.373686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 696/1395] 10.222.0.40 () {58 vars in 1064 bytes} [Wed Aug 10 11:15:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:50.381189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f1ff-bd06-4819-b1eb-941647ad1a28 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:50.382663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1ae7f1ff-bd06-4819-b1eb-941647ad1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:50.396655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:50.488942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f1ff-bd06-4819-b1eb-941647ad1a28 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:50.562906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12157-924d-40d8-82f6-99214261d14f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc7327f524a450e8429b5008166e5d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:50.563430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12157-924d-40d8-82f6-99214261d14f service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:50.563707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12157-924d-40d8-82f6-99214261d14f service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:50.563976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12157-924d-40d8-82f6-99214261d14f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:50.565592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-71f12157-924d-40d8-82f6-99214261d14f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:50.630627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:50.672399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12157-924d-40d8-82f6-99214261d14f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:50.673819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12157-924d-40d8-82f6-99214261d14f service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:50.691426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 700/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:51.553340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4532e7e-73b4-4b4c-9bcb-6fb3a0552e54 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:51.553815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4532e7e-73b4-4b4c-9bcb-6fb3a0552e54 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:51.553908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4532e7e-73b4-4b4c-9bcb-6fb3a0552e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:51.623434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e4532e7e-73b4-4b4c-9bcb-6fb3a0552e54 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:51.624672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e4532e7e-73b4-4b4c-9bcb-6fb3a0552e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:51.633294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:51.675119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515513f-87ba-485a-8e2b-1af420786a39 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:51.675648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515513f-87ba-485a-8e2b-1af420786a39 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:51.675648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515513f-87ba-485a-8e2b-1af420786a39 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:51.677032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 701/1397] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:15:51.682099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12e17-c16e-4312-8211-fe0e3ab52189 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:51.682379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12e17-c16e-4312-8211-fe0e3ab52189 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:51.682647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12e17-c16e-4312-8211-fe0e3ab52189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:51.714067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 697/1398] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:15:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:51.751717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f9f12e17-c16e-4312-8211-fe0e3ab52189 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:51.753008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f9f12e17-c16e-4312-8211-fe0e3ab52189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:51.762296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a757a9-3ee9-4ad1-97e9-a77596216263 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:51.762587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a757a9-3ee9-4ad1-97e9-a77596216263 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:51.762863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a757a9-3ee9-4ad1-97e9-a77596216263 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:51.764363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 698/1399] 10.222.0.40 () {54 vars in 943 bytes} [Wed Aug 10 11:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:15:51.771272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f1a2f-d465-47ce-befb-80aaccc8eb10 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:51.771631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f1a2f-d465-47ce-befb-80aaccc8eb10 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:51.771958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f1a2f-d465-47ce-befb-80aaccc8eb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:51.849483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-4b6f1a2f-d465-47ce-befb-80aaccc8eb10 None None] MFA Rules not processed for user `4f582800a7004e78a6fab0038b94cb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:51.850679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4b6f1a2f-d465-47ce-befb-80aaccc8eb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:51.853753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 702/1400] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:51.898564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12e17-c16e-4312-8211-fe0e3ab52189 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:51.899769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f9f12e17-c16e-4312-8211-fe0e3ab52189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:51.927090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:51.942152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:51.964994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 699/1401] 10.222.0.40 () {58 vars in 1040 bytes} [Wed Aug 10 11:15:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:15:51.975977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f1a2f-d465-47ce-befb-80aaccc8eb10 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:51.987301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f1a2f-d465-47ce-befb-80aaccc8eb10 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:52.033349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12e17-c16e-4312-8211-fe0e3ab52189 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:52.094393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e3344-633a-4e95-b10d-30a296c07035 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:52.095005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3344-633a-4e95-b10d-30a296c07035 service swift] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:52.095280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3344-633a-4e95-b10d-30a296c07035 service swift] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:52.095548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e3344-633a-4e95-b10d-30a296c07035 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:52.097194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-072e3344-633a-4e95-b10d-30a296c07035 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:52.161091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a32b6-8e86-4e20-872a-8b007dfd1b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:52.162150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a32b6-8e86-4e20-872a-8b007dfd1b3d service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:52.163152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a32b6-8e86-4e20-872a-8b007dfd1b3d service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:52.163837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a32b6-8e86-4e20-872a-8b007dfd1b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:52.166984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2d8a32b6-8e86-4e20-872a-8b007dfd1b3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:52.197760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3344-633a-4e95-b10d-30a296c07035 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:52.198163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:52.200162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e3344-633a-4e95-b10d-30a296c07035 service swift] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:52.213986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 700/1402] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:15:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 11:15:52.299841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a32b6-8e86-4e20-872a-8b007dfd1b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:52.302362 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a32b6-8e86-4e20-872a-8b007dfd1b3d service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:52.329133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 703/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:15:54.590886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8288fba-148b-4c1a-8330-fa50d0d07799 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:54.591506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8288fba-148b-4c1a-8330-fa50d0d07799 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:54.591506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8288fba-148b-4c1a-8330-fa50d0d07799 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:54.595565 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 701/1404] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:54.598997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232298-cf39-478e-b1ee-b6c7e3238857 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:54.599473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232298-cf39-478e-b1ee-b6c7e3238857 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:54.599579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232298-cf39-478e-b1ee-b6c7e3238857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:54.678600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0d232298-cf39-478e-b1ee-b6c7e3238857 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:54.683560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0d232298-cf39-478e-b1ee-b6c7e3238857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:54.799988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:54.806339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 704/1405] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:54.859545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8288fba-148b-4c1a-8330-fa50d0d07799 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:54.865236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b8288fba-148b-4c1a-8330-fa50d0d07799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:54.876608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:55.031633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8288fba-148b-4c1a-8330-fa50d0d07799 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:55.119268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:55.155964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59380d7-6aa5-412f-9982-ad96811a85d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:55.156590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59380d7-6aa5-412f-9982-ad96811a85d2 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:55.156856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59380d7-6aa5-412f-9982-ad96811a85d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:55.157127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59380d7-6aa5-412f-9982-ad96811a85d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:55.158721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e59380d7-6aa5-412f-9982-ad96811a85d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:55.263111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59380d7-6aa5-412f-9982-ad96811a85d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:55.265492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59380d7-6aa5-412f-9982-ad96811a85d2 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:55.287000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 702/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:15:57.457381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f842d-2bc7-44f3-9ada-7e096f7ed3f5 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:57.457939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f842d-2bc7-44f3-9ada-7e096f7ed3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:57.457939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f842d-2bc7-44f3-9ada-7e096f7ed3f5 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:57.459158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 705/1407] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:15:57.464332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3852-5f80-4a52-9418-8057ccf8ba7a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:57.464744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3852-5f80-4a52-9418-8057ccf8ba7a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:57.464882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3852-5f80-4a52-9418-8057ccf8ba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:57.542929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5b6d3852-5f80-4a52-9418-8057ccf8ba7a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:15:57.544137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5b6d3852-5f80-4a52-9418-8057ccf8ba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:57.595659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:57.649205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 703/1408] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:15:57.693438 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f842d-2bc7-44f3-9ada-7e096f7ed3f5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:15:57.695253 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0d2f842d-2bc7-44f3-9ada-7e096f7ed3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:57.863183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f842d-2bc7-44f3-9ada-7e096f7ed3f5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:15:57.941805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:58.000060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8a331-d249-4218-bddb-8de72572d739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:15:58.000832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8a331-d249-4218-bddb-8de72572d739 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:15:58.001181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8a331-d249-4218-bddb-8de72572d739 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:15:58.001528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8a331-d249-4218-bddb-8de72572d739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:15:58.005382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3af8a331-d249-4218-bddb-8de72572d739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:15:58.107207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8a331-d249-4218-bddb-8de72572d739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:15:58.108920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8a331-d249-4218-bddb-8de72572d739 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:15:58.128027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 706/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:07.647059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=23 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:08.125471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=64 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:16.095046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318f88-e379-4f44-badf-48ded61fca04 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:16.095575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318f88-e379-4f44-badf-48ded61fca04 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:16.095575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318f88-e379-4f44-badf-48ded61fca04 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:16.096880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 704/1410] 10.222.0.40 () {54 vars in 918 bytes} [Wed Aug 10 11:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:16.101863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592a149-e78f-4273-a5bc-9544ab1a4666 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:16.102318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592a149-e78f-4273-a5bc-9544ab1a4666 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:16.102431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592a149-e78f-4273-a5bc-9544ab1a4666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:16.176462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a592a149-e78f-4273-a5bc-9544ab1a4666 None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:16.177640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a592a149-e78f-4273-a5bc-9544ab1a4666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:16.280267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 707/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 10 11:16:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:16.295591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5743fa0-1e95-4668-b358-06f240508c94 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:16.298058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5743fa0-1e95-4668-b358-06f240508c94 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:16.298058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5743fa0-1e95-4668-b358-06f240508c94 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:16.298360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 705/1412] 10.222.0.40 () {54 vars in 918 bytes} [Wed Aug 10 11:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:16.302714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee050d27-e447-4340-8f26-1d6dbae51dc3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:16.303003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee050d27-e447-4340-8f26-1d6dbae51dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:16.303279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee050d27-e447-4340-8f26-1d6dbae51dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:16.373817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:16.376820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ee050d27-e447-4340-8f26-1d6dbae51dc3 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:16.378008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ee050d27-e447-4340-8f26-1d6dbae51dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:16.491663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 708/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 10 11:16:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:18.947535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4886b6-8393-49b6-8c3e-0108d941a094 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:18.948097 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4886b6-8393-49b6-8c3e-0108d941a094 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:18.948097 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4886b6-8393-49b6-8c3e-0108d941a094 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:18.949495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:18.955406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2a51-8dfc-4a5b-ab7d-d7cbd390a10f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:18.955850 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2a51-8dfc-4a5b-ab7d-d7cbd390a10f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:18.955963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd2a51-8dfc-4a5b-ab7d-d7cbd390a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:19.020585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1dcd2a51-8dfc-4a5b-ab7d-d7cbd390a10f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:19.021791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1dcd2a51-8dfc-4a5b-ab7d-d7cbd390a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:19.075877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:19.118768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:19.162121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4886b6-8393-49b6-8c3e-0108d941a094 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:19.163614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5f4886b6-8393-49b6-8c3e-0108d941a094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:19.306522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4886b6-8393-49b6-8c3e-0108d941a094 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:19.379079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:19.419183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4016-f44e-4ea7-b376-11855c484ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:19.419784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4016-f44e-4ea7-b376-11855c484ca1 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:19.420066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4016-f44e-4ea7-b376-11855c484ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:19.420364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4016-f44e-4ea7-b376-11855c484ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:19.422501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-309c4016-f44e-4ea7-b376-11855c484ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:19.509315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c4016-f44e-4ea7-b376-11855c484ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:19.510899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c4016-f44e-4ea7-b376-11855c484ca1 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:19.528371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 707/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:20.419305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533e83-ca30-46ed-af57-902671ca2e5f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:20.419874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533e83-ca30-46ed-af57-902671ca2e5f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:20.419874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533e83-ca30-46ed-af57-902671ca2e5f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:20.421212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:20.427009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb63a18-dbed-45bb-98ae-63c3ff5f5b8c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:20.427439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb63a18-dbed-45bb-98ae-63c3ff5f5b8c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:20.427568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb63a18-dbed-45bb-98ae-63c3ff5f5b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:20.504411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-0fb63a18-dbed-45bb-98ae-63c3ff5f5b8c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:20.505617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0fb63a18-dbed-45bb-98ae-63c3ff5f5b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:20.532597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:20.601025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:20.750156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5533e83-ca30-46ed-af57-902671ca2e5f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:20.751594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c5533e83-ca30-46ed-af57-902671ca2e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:20.895635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5533e83-ca30-46ed-af57-902671ca2e5f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:20.935540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:21.007311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553354f-f4f5-4259-aebc-d6e572ff629e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:21.007840 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553354f-f4f5-4259-aebc-d6e572ff629e service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:21.008119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553354f-f4f5-4259-aebc-d6e572ff629e service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:21.008421 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553354f-f4f5-4259-aebc-d6e572ff629e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:21.010024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7553354f-f4f5-4259-aebc-d6e572ff629e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:21.098592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553354f-f4f5-4259-aebc-d6e572ff629e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:21.100159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553354f-f4f5-4259-aebc-d6e572ff629e service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:21.117785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 711/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:21.999217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ef519-fad6-4ed3-beb2-b89eadf3f7ca None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:22.000665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ef519-fad6-4ed3-beb2-b89eadf3f7ca None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:22.000665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ef519-fad6-4ed3-beb2-b89eadf3f7ca None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:22.001770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:22.006597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4825f-1dab-4aa8-9aba-228f42773df4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:22.007023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4825f-1dab-4aa8-9aba-228f42773df4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:22.007133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4825f-1dab-4aa8-9aba-228f42773df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:22.060743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:22.088018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2ed4825f-1dab-4aa8-9aba-228f42773df4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:22.088018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2ed4825f-1dab-4aa8-9aba-228f42773df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:22.177783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:22.329884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ef519-fad6-4ed3-beb2-b89eadf3f7ca None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:22.331421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6c1ef519-fad6-4ed3-beb2-b89eadf3f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:22.472936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ef519-fad6-4ed3-beb2-b89eadf3f7ca None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:22.484568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:22.581550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e0d54-6bae-474e-bf82-a1f230aba240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:22.582152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0d54-6bae-474e-bf82-a1f230aba240 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:22.582448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0d54-6bae-474e-bf82-a1f230aba240 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:22.582713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0d54-6bae-474e-bf82-a1f230aba240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:22.584274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-550e0d54-6bae-474e-bf82-a1f230aba240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:22.670489 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e0d54-6bae-474e-bf82-a1f230aba240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:22.672068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e0d54-6bae-474e-bf82-a1f230aba240 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:22.689190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 710/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:23.544467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751529-8439-44f3-bc99-968541d73d9e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:23.545061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751529-8439-44f3-bc99-968541d73d9e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:23.545061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c751529-8439-44f3-bc99-968541d73d9e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:23.546406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:23.551166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad060ff9-4f5f-4883-a1af-e80409afdf52 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:23.551582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad060ff9-4f5f-4883-a1af-e80409afdf52 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:23.551718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad060ff9-4f5f-4883-a1af-e80409afdf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:23.571553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:23.627530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ad060ff9-4f5f-4883-a1af-e80409afdf52 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:23.628785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ad060ff9-4f5f-4883-a1af-e80409afdf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:23.721407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:23.870786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c751529-8439-44f3-bc99-968541d73d9e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:23.872287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9c751529-8439-44f3-bc99-968541d73d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:23.980684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:24.015495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c751529-8439-44f3-bc99-968541d73d9e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:24.123833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed127776-ab72-47da-9f40-cf0285133162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:24.124411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127776-ab72-47da-9f40-cf0285133162 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:24.124693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127776-ab72-47da-9f40-cf0285133162 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:24.124955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127776-ab72-47da-9f40-cf0285133162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:24.126530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ed127776-ab72-47da-9f40-cf0285133162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:24.203591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:24.216510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed127776-ab72-47da-9f40-cf0285133162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:24.218696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed127776-ab72-47da-9f40-cf0285133162 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:24.236748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 714/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:25.100420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd5c0-f6ab-496c-9e5c-8e06a13ae861 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:25.100980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd5c0-f6ab-496c-9e5c-8e06a13ae861 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:25.100980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd5c0-f6ab-496c-9e5c-8e06a13ae861 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:25.102217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:25.107032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1786-188d-4b20-8853-e46fc1b29b6a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:25.107438 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1786-188d-4b20-8853-e46fc1b29b6a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:25.107575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f1786-188d-4b20-8853-e46fc1b29b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:25.181855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e86f1786-188d-4b20-8853-e46fc1b29b6a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:25.183097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e86f1786-188d-4b20-8853-e46fc1b29b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:25.277422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:25.428494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edd5c0-f6ab-496c-9e5c-8e06a13ae861 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:25.430051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e7edd5c0-f6ab-496c-9e5c-8e06a13ae861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:25.512709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:25.573701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edd5c0-f6ab-496c-9e5c-8e06a13ae861 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:25.683138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc186b0-bf46-4e87-8044-f774b7ee4490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:25.683662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc186b0-bf46-4e87-8044-f774b7ee4490 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:25.683940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc186b0-bf46-4e87-8044-f774b7ee4490 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:25.684209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc186b0-bf46-4e87-8044-f774b7ee4490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:25.685812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5dc186b0-bf46-4e87-8044-f774b7ee4490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:25.732705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:25.773313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc186b0-bf46-4e87-8044-f774b7ee4490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:25.774953 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc186b0-bf46-4e87-8044-f774b7ee4490 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:25.793861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 713/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:26.660801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950208b-46cd-43ff-b6f1-47ef4f4cf2e8 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:26.661423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950208b-46cd-43ff-b6f1-47ef4f4cf2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:26.661423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950208b-46cd-43ff-b6f1-47ef4f4cf2e8 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:26.662663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:26.667471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f5a0-ba7f-47d2-9da4-4fdbcaa0e983 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:26.667940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f5a0-ba7f-47d2-9da4-4fdbcaa0e983 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:26.668056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f5a0-ba7f-47d2-9da4-4fdbcaa0e983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:26.742467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c7c9f5a0-ba7f-47d2-9da4-4fdbcaa0e983 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:26.743652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c7c9f5a0-ba7f-47d2-9da4-4fdbcaa0e983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:26.839831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:26.990944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950208b-46cd-43ff-b6f1-47ef4f4cf2e8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:26.992545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8950208b-46cd-43ff-b6f1-47ef4f4cf2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:27.039980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:27.135828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950208b-46cd-43ff-b6f1-47ef4f4cf2e8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:27.248601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aae9b-e771-45ea-93a6-993f0874c680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:27.249797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aae9b-e771-45ea-93a6-993f0874c680 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:27.250114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aae9b-e771-45ea-93a6-993f0874c680 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:27.250386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aae9b-e771-45ea-93a6-993f0874c680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:27.251969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d7aae9b-e771-45ea-93a6-993f0874c680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:27.258737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:27.341361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7aae9b-e771-45ea-93a6-993f0874c680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:27.343754 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7aae9b-e771-45ea-93a6-993f0874c680 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:27.362302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 717/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:28.201022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579115-235f-45cd-b661-aea440a8d990 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.201602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579115-235f-45cd-b661-aea440a8d990 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.201602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579115-235f-45cd-b661-aea440a8d990 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.203028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:28.207963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd6c2-43e2-45c8-bacf-d44579281f97 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.208389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd6c2-43e2-45c8-bacf-d44579281f97 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.208576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd6c2-43e2-45c8-bacf-d44579281f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.283162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5e7bd6c2-43e2-45c8-bacf-d44579281f97 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:28.284374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5e7bd6c2-43e2-45c8-bacf-d44579281f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:28.350316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:28.378764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:28.533120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff579115-235f-45cd-b661-aea440a8d990 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:28.534636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ff579115-235f-45cd-b661-aea440a8d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:28.551824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:28.676850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff579115-235f-45cd-b661-aea440a8d990 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:28.762035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:28.787827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667fe0-5c53-4208-bd09-9aea61970bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:28.788455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667fe0-5c53-4208-bd09-9aea61970bd0 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:28.788732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667fe0-5c53-4208-bd09-9aea61970bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:28.789001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667fe0-5c53-4208-bd09-9aea61970bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:28.790556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-16667fe0-5c53-4208-bd09-9aea61970bd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:28.879939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667fe0-5c53-4208-bd09-9aea61970bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:28.881556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667fe0-5c53-4208-bd09-9aea61970bd0 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:28.899500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 716/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:29.734499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43956e4-a208-4329-940a-9ce8be365067 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:29.735016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43956e4-a208-4329-940a-9ce8be365067 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:29.735016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43956e4-a208-4329-940a-9ce8be365067 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:29.736339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:29.741364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacac01-ff1d-4322-9fa3-7ebb92b2a7cb None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:29.741794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacac01-ff1d-4322-9fa3-7ebb92b2a7cb None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:29.742042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacac01-ff1d-4322-9fa3-7ebb92b2a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:29.816663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-3eacac01-ff1d-4322-9fa3-7ebb92b2a7cb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:29.817856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3eacac01-ff1d-4322-9fa3-7ebb92b2a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:29.859317 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:29.911728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:30.062601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43956e4-a208-4329-940a-9ce8be365067 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:30.064061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f43956e4-a208-4329-940a-9ce8be365067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:30.205838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43956e4-a208-4329-940a-9ce8be365067 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:30.258481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:30.317574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21657e-6859-4f16-aaec-928267a00a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:30.318114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21657e-6859-4f16-aaec-928267a00a43 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:30.318395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21657e-6859-4f16-aaec-928267a00a43 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:30.318665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21657e-6859-4f16-aaec-928267a00a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:30.320270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cd21657e-6859-4f16-aaec-928267a00a43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:30.408464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21657e-6859-4f16-aaec-928267a00a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:30.410042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21657e-6859-4f16-aaec-928267a00a43 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:30.428081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 720/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:31.309121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeea1c-f6de-4051-9d78-8f6e6b4c35a4 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:31.309689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeea1c-f6de-4051-9d78-8f6e6b4c35a4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:31.309689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeea1c-f6de-4051-9d78-8f6e6b4c35a4 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:31.311696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:31.316776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd087-c6f3-41e4-beca-639df4de45db None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:31.317179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd087-c6f3-41e4-beca-639df4de45db None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:31.317348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabd087-c6f3-41e4-beca-639df4de45db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:31.391801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-aaabd087-c6f3-41e4-beca-639df4de45db None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:31.393012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-aaabd087-c6f3-41e4-beca-639df4de45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:31.394964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:31.487729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:31.641661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeea1c-f6de-4051-9d78-8f6e6b4c35a4 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:31.644883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9adeea1c-f6de-4051-9d78-8f6e6b4c35a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:31.785335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeea1c-f6de-4051-9d78-8f6e6b4c35a4 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:31.810776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:31.896247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5680f5-7520-4f0e-9b21-76692cbed40a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:31.896835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5680f5-7520-4f0e-9b21-76692cbed40a service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:31.897112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5680f5-7520-4f0e-9b21-76692cbed40a service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:31.897385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5680f5-7520-4f0e-9b21-76692cbed40a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:31.898964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3c5680f5-7520-4f0e-9b21-76692cbed40a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:31.987291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5680f5-7520-4f0e-9b21-76692cbed40a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:31.988906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5680f5-7520-4f0e-9b21-76692cbed40a service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:32.006286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 719/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:33.924825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1438e-5892-4e53-ae8d-f803c2f2905d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:33.925386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1438e-5892-4e53-ae8d-f803c2f2905d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:33.925386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1438e-5892-4e53-ae8d-f803c2f2905d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:33.926682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:33.931923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68ef86-4179-4b24-b63b-5989ba25da5a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:33.932380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68ef86-4179-4b24-b63b-5989ba25da5a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:33.932496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68ef86-4179-4b24-b63b-5989ba25da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:33.973046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:33.996881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-6a68ef86-4179-4b24-b63b-5989ba25da5a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:33.998073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6a68ef86-4179-4b24-b63b-5989ba25da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:34.092017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:34.130925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1438e-5892-4e53-ae8d-f803c2f2905d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:34.132532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-64d1438e-5892-4e53-ae8d-f803c2f2905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:34.235012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1438e-5892-4e53-ae8d-f803c2f2905d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:34.265739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:34.306764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34346b8d-31a1-4cef-a030-6e9f5def151d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:34.307361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34346b8d-31a1-4cef-a030-6e9f5def151d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:34.307636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34346b8d-31a1-4cef-a030-6e9f5def151d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:34.307902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34346b8d-31a1-4cef-a030-6e9f5def151d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:34.309532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-34346b8d-31a1-4cef-a030-6e9f5def151d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:34.415548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34346b8d-31a1-4cef-a030-6e9f5def151d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:34.416987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34346b8d-31a1-4cef-a030-6e9f5def151d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:34.435201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 723/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:36.624110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcecb7-07ab-479d-ab2a-e2aed84f3e5c None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.624667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcecb7-07ab-479d-ab2a-e2aed84f3e5c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.624795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcecb7-07ab-479d-ab2a-e2aed84f3e5c None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.626147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:36.631617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79492d8-a033-463a-b87c-70777634682a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:36.632020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79492d8-a033-463a-b87c-70777634682a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:36.632217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79492d8-a033-463a-b87c-70777634682a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:36.696967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d79492d8-a033-463a-b87c-70777634682a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:36.698150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d79492d8-a033-463a-b87c-70777634682a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:36.710389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:36.791901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:36.830983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcecb7-07ab-479d-ab2a-e2aed84f3e5c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:36.832535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d0dcecb7-07ab-479d-ab2a-e2aed84f3e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:36.938750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcecb7-07ab-479d-ab2a-e2aed84f3e5c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:36.950465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:37.010271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932df50-fd61-4c99-a52a-b873aa39d640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:37.010937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932df50-fd61-4c99-a52a-b873aa39d640 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:37.011221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932df50-fd61-4c99-a52a-b873aa39d640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:37.011492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932df50-fd61-4c99-a52a-b873aa39d640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:37.013111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7932df50-fd61-4c99-a52a-b873aa39d640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:37.121139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932df50-fd61-4c99-a52a-b873aa39d640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:37.122498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932df50-fd61-4c99-a52a-b873aa39d640 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:37.140846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 722/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:39.524120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419c858-3009-463e-b883-bf88175e6320 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:39.524731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419c858-3009-463e-b883-bf88175e6320 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:39.524731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419c858-3009-463e-b883-bf88175e6320 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:39.526028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:39.532098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4a32-a1ad-406f-8fb9-d5e59c12f245 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:39.532537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4a32-a1ad-406f-8fb9-d5e59c12f245 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:39.532691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4a32-a1ad-406f-8fb9-d5e59c12f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:39.580779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:39.598963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5d4b4a32-a1ad-406f-8fb9-d5e59c12f245 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:39.601419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5d4b4a32-a1ad-406f-8fb9-d5e59c12f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:39.695330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:39.735055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419c858-3009-463e-b883-bf88175e6320 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:39.736619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4419c858-3009-463e-b883-bf88175e6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:39.838483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419c858-3009-463e-b883-bf88175e6320 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:39.877693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:39.911723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624319e-a52e-4702-a3dc-7c15461710b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:39.912348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624319e-a52e-4702-a3dc-7c15461710b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:39.912630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624319e-a52e-4702-a3dc-7c15461710b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:39.912899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624319e-a52e-4702-a3dc-7c15461710b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:39.914485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5624319e-a52e-4702-a3dc-7c15461710b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:40.019582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624319e-a52e-4702-a3dc-7c15461710b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:40.021030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624319e-a52e-4702-a3dc-7c15461710b4 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:40.044204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 726/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:42.178351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4ad94-452d-4cf0-bb7f-706524476154 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:42.178882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4ad94-452d-4cf0-bb7f-706524476154 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:42.178882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4ad94-452d-4cf0-bb7f-706524476154 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:42.180221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:42.185662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcf219-63f5-4925-9874-9268f264fe58 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:42.186096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcf219-63f5-4925-9874-9268f264fe58 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:42.186255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcf219-63f5-4925-9874-9268f264fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:42.251290 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7ffcf219-63f5-4925-9874-9268f264fe58 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:42.252499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7ffcf219-63f5-4925-9874-9268f264fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:42.272876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:42.349825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:16:42.388452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4ad94-452d-4cf0-bb7f-706524476154 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:42.390523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4da4ad94-452d-4cf0-bb7f-706524476154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:42.490202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4ad94-452d-4cf0-bb7f-706524476154 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:42.510223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:42.564328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029fd65-a960-41ee-9334-87255900f5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:42.564947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fd65-a960-41ee-9334-87255900f5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:42.565227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fd65-a960-41ee-9334-87255900f5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:42.565495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fd65-a960-41ee-9334-87255900f5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:42.567064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0029fd65-a960-41ee-9334-87255900f5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:42.672457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029fd65-a960-41ee-9334-87255900f5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:42.673879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029fd65-a960-41ee-9334-87255900f5e4 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:42.692116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 725/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:44.763318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff7e8-9055-4863-86e4-8dd9cbb45f83 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:44.764558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff7e8-9055-4863-86e4-8dd9cbb45f83 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:44.764558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ff7e8-9055-4863-86e4-8dd9cbb45f83 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:44.765853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:44.771160 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab72504-a1e3-4659-b7d9-b1a688808b00 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:44.771572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab72504-a1e3-4659-b7d9-b1a688808b00 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:44.771678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab72504-a1e3-4659-b7d9-b1a688808b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:44.836288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:44.839338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-4ab72504-a1e3-4659-b7d9-b1a688808b00 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:44.840609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4ab72504-a1e3-4659-b7d9-b1a688808b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:44.934543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:44.974277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff7e8-9055-4863-86e4-8dd9cbb45f83 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:44.975801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-da5ff7e8-9055-4863-86e4-8dd9cbb45f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:45.080553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ff7e8-9055-4863-86e4-8dd9cbb45f83 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:45.127858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:45.152055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e44a1d-c7bb-4cdd-86bb-4b90256e4c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:45.152696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44a1d-c7bb-4cdd-86bb-4b90256e4c75 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:45.153174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44a1d-c7bb-4cdd-86bb-4b90256e4c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:45.153488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44a1d-c7bb-4cdd-86bb-4b90256e4c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:45.156550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c8e44a1d-c7bb-4cdd-86bb-4b90256e4c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:45.263194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e44a1d-c7bb-4cdd-86bb-4b90256e4c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:45.264687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e44a1d-c7bb-4cdd-86bb-4b90256e4c75 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:45.282925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 729/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:47.353288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3bb8f-e763-4f49-a20b-305b34ec3459 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.353829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3bb8f-e763-4f49-a20b-305b34ec3459 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.353829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3bb8f-e763-4f49-a20b-305b34ec3459 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.355159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:47.361141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20911bce-9154-40f3-b1d4-2bb99653276a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.361573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20911bce-9154-40f3-b1d4-2bb99653276a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.366702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20911bce-9154-40f3-b1d4-2bb99653276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.428339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-20911bce-9154-40f3-b1d4-2bb99653276a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:47.429597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-20911bce-9154-40f3-b1d4-2bb99653276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:47.458942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:47.525865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:47.564982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3bb8f-e763-4f49-a20b-305b34ec3459 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:47.566494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-05e3bb8f-e763-4f49-a20b-305b34ec3459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:47.667611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3bb8f-e763-4f49-a20b-305b34ec3459 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:47.696439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:47.741644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f043e-145a-4809-bc55-42f464c0de04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:47.742251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f043e-145a-4809-bc55-42f464c0de04 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:47.742531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f043e-145a-4809-bc55-42f464c0de04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:47.742804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f043e-145a-4809-bc55-42f464c0de04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:47.744416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8a4f043e-145a-4809-bc55-42f464c0de04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:47.853199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f043e-145a-4809-bc55-42f464c0de04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:47.854639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f043e-145a-4809-bc55-42f464c0de04 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:47.873181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 728/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:50.000232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db2682-95b4-4c12-9d36-dbcb856908f4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.000805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db2682-95b4-4c12-9d36-dbcb856908f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.000937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db2682-95b4-4c12-9d36-dbcb856908f4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.002154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:50.007503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fe65-3cfd-430e-853c-7989200863e0 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.007909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fe65-3cfd-430e-853c-7989200863e0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.008050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fe65-3cfd-430e-853c-7989200863e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.074124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5078fe65-3cfd-430e-853c-7989200863e0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:50.075371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5078fe65-3cfd-430e-853c-7989200863e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:50.083556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:50.170451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:50.207647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db2682-95b4-4c12-9d36-dbcb856908f4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:50.209213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-94db2682-95b4-4c12-9d36-dbcb856908f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:50.310308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db2682-95b4-4c12-9d36-dbcb856908f4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:50.365072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:50.382641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302e184-2648-4924-916f-eebfad6e15e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:50.383244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e184-2648-4924-916f-eebfad6e15e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:50.383520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e184-2648-4924-916f-eebfad6e15e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:50.383786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302e184-2648-4924-916f-eebfad6e15e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:50.385415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7302e184-2648-4924-916f-eebfad6e15e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:50.493445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302e184-2648-4924-916f-eebfad6e15e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:50.494876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302e184-2648-4924-916f-eebfad6e15e5 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:50.513418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 732/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:52.635465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ab60-a1a5-4c0c-acca-656112a1fc06 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:52.636047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ab60-a1a5-4c0c-acca-656112a1fc06 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:52.636047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ab60-a1a5-4c0c-acca-656112a1fc06 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:52.637419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:52.643098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bcb94-96b0-474c-8251-566a437d86aa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:52.643547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bcb94-96b0-474c-8251-566a437d86aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:52.643733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bcb94-96b0-474c-8251-566a437d86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:52.712617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d69bcb94-96b0-474c-8251-566a437d86aa None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:52.713834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d69bcb94-96b0-474c-8251-566a437d86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:52.755570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:52.818240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:52.856099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9ab60-a1a5-4c0c-acca-656112a1fc06 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:52.858376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-87e9ab60-a1a5-4c0c-acca-656112a1fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:52.958730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9ab60-a1a5-4c0c-acca-656112a1fc06 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:52.996075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:53.031320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb5ed-020c-4cf6-8673-6b56f202ea94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:53.031923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb5ed-020c-4cf6-8673-6b56f202ea94 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:53.032203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb5ed-020c-4cf6-8673-6b56f202ea94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:53.032503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb5ed-020c-4cf6-8673-6b56f202ea94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:53.035090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-bcacb5ed-020c-4cf6-8673-6b56f202ea94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:53.140563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb5ed-020c-4cf6-8673-6b56f202ea94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:53.142034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb5ed-020c-4cf6-8673-6b56f202ea94 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:53.161070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 731/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:55.168010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c3b45-ccf6-4aac-96e7-71723a49d7aa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.168597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c3b45-ccf6-4aac-96e7-71723a49d7aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.168597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c3b45-ccf6-4aac-96e7-71723a49d7aa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.170699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:55.175947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e6b3-d4e0-4ff6-8c6f-e49d639a3c5a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.176388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e6b3-d4e0-4ff6-8c6f-e49d639a3c5a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.176558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e6b3-d4e0-4ff6-8c6f-e49d639a3c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.240966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ca04e6b3-d4e0-4ff6-8c6f-e49d639a3c5a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:55.242147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ca04e6b3-d4e0-4ff6-8c6f-e49d639a3c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:55.259824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:55.341427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:55.378303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c3b45-ccf6-4aac-96e7-71723a49d7aa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:55.379814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6d2c3b45-ccf6-4aac-96e7-71723a49d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:55.481547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c3b45-ccf6-4aac-96e7-71723a49d7aa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:55.547585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:55.554341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb23a04-49aa-49b8-9741-772ca7430d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:55.554952 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23a04-49aa-49b8-9741-772ca7430d57 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:55.559916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23a04-49aa-49b8-9741-772ca7430d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:55.559916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23a04-49aa-49b8-9741-772ca7430d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:55.559916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dbb23a04-49aa-49b8-9741-772ca7430d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:55.666298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb23a04-49aa-49b8-9741-772ca7430d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:55.667723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb23a04-49aa-49b8-9741-772ca7430d57 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:55.685663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 735/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:57.791461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba4b42-ac87-44b5-8d64-6c6614a9676d None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:57.792077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba4b42-ac87-44b5-8d64-6c6614a9676d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:57.792077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba4b42-ac87-44b5-8d64-6c6614a9676d None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:57.793367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:16:57.798815 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20484-e835-421f-8c45-0e83996cec50 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:57.799262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20484-e835-421f-8c45-0e83996cec50 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:57.799379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd20484-e835-421f-8c45-0e83996cec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:57.865894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bcd20484-e835-421f-8c45-0e83996cec50 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:16:57.867095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bcd20484-e835-421f-8c45-0e83996cec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:57.916962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:57.967848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:16:58.004931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba4b42-ac87-44b5-8d64-6c6614a9676d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:16:58.006456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2eba4b42-ac87-44b5-8d64-6c6614a9676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.114263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba4b42-ac87-44b5-8d64-6c6614a9676d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:16:58.161560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:58.187212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbec8fa-10c1-450d-8981-557ec44fbf42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:16:58.187811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec8fa-10c1-450d-8981-557ec44fbf42 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:16:58.188087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec8fa-10c1-450d-8981-557ec44fbf42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:16:58.188380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbec8fa-10c1-450d-8981-557ec44fbf42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:16:58.189945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2dbec8fa-10c1-450d-8981-557ec44fbf42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:16:58.296372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbec8fa-10c1-450d-8981-557ec44fbf42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:16:58.297808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbec8fa-10c1-450d-8981-557ec44fbf42 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:16:58.315899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 734/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:07.965483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=22 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:08.313591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=66 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:17.845105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff14a-dd0d-409b-b370-48ceffb0ebfa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.845597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff14a-dd0d-409b-b370-48ceffb0ebfa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.845713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dff14a-dd0d-409b-b370-48ceffb0ebfa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.846984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 737/1471] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:17:17.852020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b15a7-5dd4-481e-a5db-345d82c30344 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:17.852465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b15a7-5dd4-481e-a5db-345d82c30344 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:17.852578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b15a7-5dd4-481e-a5db-345d82c30344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:17.916866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-de3b15a7-5dd4-481e-a5db-345d82c30344 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:17.918654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-de3b15a7-5dd4-481e-a5db-345d82c30344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:18.012903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 735/1472] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:18.095781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04ab4-b254-4865-8eeb-6cf066eee578 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:18.096063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04ab4-b254-4865-8eeb-6cf066eee578 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:18.096352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04ab4-b254-4865-8eeb-6cf066eee578 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:18.097657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 738/1473] 10.222.0.40 () {54 vars in 967 bytes} [Wed Aug 10 11:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:17:18.102322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d5c2-aa82-45d7-8110-f3e39918543b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:18.102610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d5c2-aa82-45d7-8110-f3e39918543b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:18.102880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d5c2-aa82-45d7-8110-f3e39918543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:18.177436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a7e8d5c2-aa82-45d7-8110-f3e39918543b None None] MFA Rules not processed for user `fcc7327f524a450e8429b5008166e5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:18.188229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a7e8d5c2-aa82-45d7-8110-f3e39918543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:18.199987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:18.255584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 736/1474] 10.222.0.40 () {58 vars in 1064 bytes} [Wed Aug 10 11:17:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:18.263282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee04ab4-b254-4865-8eeb-6cf066eee578 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:18.264843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8ee04ab4-b254-4865-8eeb-6cf066eee578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:18.367637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee04ab4-b254-4865-8eeb-6cf066eee578 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:18.442535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119f770-9e02-46b1-aa44-6038cc424d62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc7327f524a450e8429b5008166e5d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:18.443148 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f770-9e02-46b1-aa44-6038cc424d62 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:18.443416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f770-9e02-46b1-aa44-6038cc424d62 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:18.443682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119f770-9e02-46b1-aa44-6038cc424d62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:18.445318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9119f770-9e02-46b1-aa44-6038cc424d62 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:18.498476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:18.552457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f770-9e02-46b1-aa44-6038cc424d62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:18.553884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119f770-9e02-46b1-aa44-6038cc424d62 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:18.571951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 739/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:20.661154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd50cb-4487-4680-a184-303ced729aca None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.661697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd50cb-4487-4680-a184-303ced729aca None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.661697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd50cb-4487-4680-a184-303ced729aca None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.663067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 737/1476] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:17:20.668510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ca3e4-a5ab-4a31-b7ce-83c3e1a7da37 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:20.668962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ca3e4-a5ab-4a31-b7ce-83c3e1a7da37 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:20.669072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ca3e4-a5ab-4a31-b7ce-83c3e1a7da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:20.734550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f83ca3e4-a5ab-4a31-b7ce-83c3e1a7da37 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:20.735756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f83ca3e4-a5ab-4a31-b7ce-83c3e1a7da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:20.833579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 740/1477] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:20.855924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd50cb-4487-4680-a184-303ced729aca None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:20.857459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5ccd50cb-4487-4680-a184-303ced729aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:20.982132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd50cb-4487-4680-a184-303ced729aca None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:21.031243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:21.074659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd2463-8c72-4d81-b8cd-24ab926aa3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:21.075303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2463-8c72-4d81-b8cd-24ab926aa3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:21.075529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2463-8c72-4d81-b8cd-24ab926aa3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:21.075799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd2463-8c72-4d81-b8cd-24ab926aa3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:21.076468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd2463-8c72-4d81-b8cd-24ab926aa3b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:21.078184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING py.warnings [None req-facd2463-8c72-4d81-b8cd-24ab926aa3b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:17:21.078184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: warnings.warn(msg) Aug 10 11:17:21.078184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: Aug 10 11:17:21.079313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd2463-8c72-4d81-b8cd-24ab926aa3b0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:21.098110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 738/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 10 11:17:20 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:17:23.143334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aacf4-495f-4c29-bf6e-4538c8033732 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.143888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aacf4-495f-4c29-bf6e-4538c8033732 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.143888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aacf4-495f-4c29-bf6e-4538c8033732 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.145220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 741/1479] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:17:23.150562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c3e5a-e0eb-4161-a724-8d8ae4ee99a0 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.151004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c3e5a-e0eb-4161-a724-8d8ae4ee99a0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.151126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c3e5a-e0eb-4161-a724-8d8ae4ee99a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.219379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-373c3e5a-e0eb-4161-a724-8d8ae4ee99a0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:23.221022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-373c3e5a-e0eb-4161-a724-8d8ae4ee99a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.319219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 739/1480] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:23.362659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aacf4-495f-4c29-bf6e-4538c8033732 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:23.364221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f81aacf4-495f-4c29-bf6e-4538c8033732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.374627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:23.508649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aacf4-495f-4c29-bf6e-4538c8033732 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:23.587827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:23.619886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179cddb-234b-4c03-a4dd-d95d4edd68c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:23.621037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179cddb-234b-4c03-a4dd-d95d4edd68c3 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:23.621315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179cddb-234b-4c03-a4dd-d95d4edd68c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:23.621589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179cddb-234b-4c03-a4dd-d95d4edd68c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:23.623395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2179cddb-234b-4c03-a4dd-d95d4edd68c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:23.712005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179cddb-234b-4c03-a4dd-d95d4edd68c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:23.713606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179cddb-234b-4c03-a4dd-d95d4edd68c3 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:23.731136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 742/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:25.907877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6340-c64c-43f1-bce9-a593a1d2996e None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.908336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6340-c64c-43f1-bce9-a593a1d2996e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.908477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6340-c64c-43f1-bce9-a593a1d2996e None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.909832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 740/1482] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:17:25.914970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5370c8-ae08-438c-9d22-824bb3b5d89a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:25.915933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5370c8-ae08-438c-9d22-824bb3b5d89a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:25.915933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5370c8-ae08-438c-9d22-824bb3b5d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:25.982124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5b5370c8-ae08-438c-9d22-824bb3b5d89a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:25.983325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5b5370c8-ae08-438c-9d22-824bb3b5d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:26.028336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:26.077263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 743/1483] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:26.114739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6340-c64c-43f1-bce9-a593a1d2996e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:26.116253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-39ef6340-c64c-43f1-bce9-a593a1d2996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:26.139470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:26.218835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6340-c64c-43f1-bce9-a593a1d2996e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:26.290683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abbd19-8a8c-4c44-a1c2-bfa601b1abe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:26.291215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abbd19-8a8c-4c44-a1c2-bfa601b1abe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:26.291491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abbd19-8a8c-4c44-a1c2-bfa601b1abe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:26.291764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abbd19-8a8c-4c44-a1c2-bfa601b1abe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:26.293499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d6abbd19-8a8c-4c44-a1c2-bfa601b1abe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:26.365229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:26.399198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abbd19-8a8c-4c44-a1c2-bfa601b1abe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:26.400677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abbd19-8a8c-4c44-a1c2-bfa601b1abe6 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:26.419635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 741/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:28.476366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52008d3-55f7-40ab-b6a8-5bb9e75e515c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:28.476984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52008d3-55f7-40ab-b6a8-5bb9e75e515c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:28.476984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52008d3-55f7-40ab-b6a8-5bb9e75e515c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:28.478231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 744/1485] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:17:28.483866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c3b9-b411-49da-a268-1aceb15f5274 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:28.484374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c3b9-b411-49da-a268-1aceb15f5274 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:28.484537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c3b9-b411-49da-a268-1aceb15f5274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:28.550523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-49d4c3b9-b411-49da-a268-1aceb15f5274 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:28.551715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-49d4c3b9-b411-49da-a268-1aceb15f5274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:28.646130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 742/1486] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:28.685945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52008d3-55f7-40ab-b6a8-5bb9e75e515c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:28.687466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a52008d3-55f7-40ab-b6a8-5bb9e75e515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:28.790678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52008d3-55f7-40ab-b6a8-5bb9e75e515c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:28.862906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:28.864677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd399e9f-a666-4733-9cee-52b9b2c45f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:28.865285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd399e9f-a666-4733-9cee-52b9b2c45f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:28.865566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd399e9f-a666-4733-9cee-52b9b2c45f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:28.865837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd399e9f-a666-4733-9cee-52b9b2c45f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:28.867422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cd399e9f-a666-4733-9cee-52b9b2c45f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:28.973429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd399e9f-a666-4733-9cee-52b9b2c45f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:28.974848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd399e9f-a666-4733-9cee-52b9b2c45f3d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:28.993342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 745/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:31.096966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a15898-2c34-416a-aa75-efd44b081496 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:31.097505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a15898-2c34-416a-aa75-efd44b081496 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:31.097505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a15898-2c34-416a-aa75-efd44b081496 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:31.098759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 743/1488] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:17:31.104083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb915-f2cc-487a-bb46-de4886ef7928 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:31.104544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb915-f2cc-487a-bb46-de4886ef7928 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:31.104642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb915-f2cc-487a-bb46-de4886ef7928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:31.169021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-53cbb915-f2cc-487a-bb46-de4886ef7928 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:31.170224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-53cbb915-f2cc-487a-bb46-de4886ef7928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:31.222880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:31.266152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 746/1489] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:17:31.306019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a15898-2c34-416a-aa75-efd44b081496 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:31.307541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-35a15898-2c34-416a-aa75-efd44b081496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:31.344398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:31.411720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a15898-2c34-416a-aa75-efd44b081496 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:31.484153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0199e3-cb06-4b61-8bd4-8f50c632d22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:31.484362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0199e3-cb06-4b61-8bd4-8f50c632d22a service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:31.484646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0199e3-cb06-4b61-8bd4-8f50c632d22a service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:31.484918 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0199e3-cb06-4b61-8bd4-8f50c632d22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:31.486564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7a0199e3-cb06-4b61-8bd4-8f50c632d22a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:31.566893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:31.595198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0199e3-cb06-4b61-8bd4-8f50c632d22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:31.596700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0199e3-cb06-4b61-8bd4-8f50c632d22a service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:31.615222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 744/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:33.992074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af51f8-0588-40b1-be3a-4926dff5dfbc None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:33.992676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af51f8-0588-40b1-be3a-4926dff5dfbc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:33.992676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af51f8-0588-40b1-be3a-4926dff5dfbc None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:33.993956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 747/1491] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 10 11:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:17:34.000068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0094-b7f2-48f1-816f-2bc2d5b074c9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:34.000551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0094-b7f2-48f1-816f-2bc2d5b074c9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:34.000675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0094-b7f2-48f1-816f-2bc2d5b074c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:34.066136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2d6d0094-b7f2-48f1-816f-2bc2d5b074c9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:17:34.067337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2d6d0094-b7f2-48f1-816f-2bc2d5b074c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:34.162712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 745/1492] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 10 11:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:17:34.203401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af51f8-0588-40b1-be3a-4926dff5dfbc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:17:34.204984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-54af51f8-0588-40b1-be3a-4926dff5dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:34.319155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af51f8-0588-40b1-be3a-4926dff5dfbc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:17:34.401516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f682f5-b51f-4756-8b7c-ecb05ea07151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:17:34.402173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f682f5-b51f-4756-8b7c-ecb05ea07151 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:17:34.402433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f682f5-b51f-4756-8b7c-ecb05ea07151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:17:34.402700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f682f5-b51f-4756-8b7c-ecb05ea07151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:17:34.404930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-61f682f5-b51f-4756-8b7c-ecb05ea07151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:17:34.414584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:34.512967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f682f5-b51f-4756-8b7c-ecb05ea07151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:17:34.514386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f682f5-b51f-4756-8b7c-ecb05ea07151 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:17:34.532796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 748/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:17:44.160934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=82 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:44.530423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=50 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:56.523128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9835b9-312f-43e7-9fdd-619ed88d4e8c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:56.523727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9835b9-312f-43e7-9fdd-619ed88d4e8c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:56.523727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9835b9-312f-43e7-9fdd-619ed88d4e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:56.597116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-4a9835b9-312f-43e7-9fdd-619ed88d4e8c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:56.598849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4a9835b9-312f-43e7-9fdd-619ed88d4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:56.693482 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 746/1494] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:56.701635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c606-4d36-40c5-8dc2-740c6ebb9a6c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:56.702139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c606-4d36-40c5-8dc2-740c6ebb9a6c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:56.702248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c606-4d36-40c5-8dc2-740c6ebb9a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:56.776111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e394c606-4d36-40c5-8dc2-740c6ebb9a6c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:56.777533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e394c606-4d36-40c5-8dc2-740c6ebb9a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:56.873175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 749/1495] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:56.877864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9835b9-312f-43e7-9fdd-619ed88d4e8c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:56.879069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4a9835b9-312f-43e7-9fdd-619ed88d4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:56.891053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9835b9-312f-43e7-9fdd-619ed88d4e8c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:56.950256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:56.982443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:56.983047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:56.983329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:56.983656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:56.984295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:18:56.984618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:56.985621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING py.warnings [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:18:56.985621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: warnings.warn(msg) Aug 10 11:18:56.985621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: Aug 10 11:18:56.986498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:56.998387 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 747/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:18:57.006971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394c606-4d36-40c5-8dc2-740c6ebb9a6c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:57.015819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394c606-4d36-40c5-8dc2-740c6ebb9a6c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:57.075451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:57.108328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:57.108948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:57.109223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:57.109486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:57.110094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:57.111787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:18:57.111787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: warnings.warn(msg) Aug 10 11:18:57.111787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: Aug 10 11:18:57.112986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:57.240896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 750/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:18:57 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:18:57.245219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:57.247679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:57.281681 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570164-35aa-4914-807c-a2575821b5a5 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:57.374557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:57.375094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:57.375373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:57.375644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:57.376270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:57.377312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING py.warnings [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:18:57.377312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: warnings.warn(msg) Aug 10 11:18:57.377312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: Aug 10 11:18:57.378512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:57.497018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 748/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:18:57 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:18:57.501333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:57.502879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:57.563948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153d36-ba4a-4d72-ad6c-363c00e70278 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:57.645035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:57.655373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:57.659983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:57.659983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:57.659983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:57.659983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:57.659983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:18:57.659983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: warnings.warn(msg) Aug 10 11:18:57.659983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: Aug 10 11:18:57.660688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:57.671462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 751/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:18:57.675593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:57.677156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:57.688932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f6380-e356-494a-b810-afeae2bad01a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:57.713057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:57.780241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e148231-9352-4b89-b418-647880625c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:57.780872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148231-9352-4b89-b418-647880625c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:57.781145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148231-9352-4b89-b418-647880625c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:57.781409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e148231-9352-4b89-b418-647880625c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:57.782042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e148231-9352-4b89-b418-647880625c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:57.783048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING py.warnings [None req-8e148231-9352-4b89-b418-647880625c6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:18:57.783048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: warnings.warn(msg) Aug 10 11:18:57.783048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: Aug 10 11:18:57.783919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e148231-9352-4b89-b418-647880625c6a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:57.796814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 749/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:18:57.801059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:57.803154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:57.836696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0aff9-624b-457b-95eb-36d51ae95248 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:57.930618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb78ff3-049c-49cc-b174-c2dfe0095522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:57.931178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78ff3-049c-49cc-b174-c2dfe0095522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:57.931455 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78ff3-049c-49cc-b174-c2dfe0095522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:57.931728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78ff3-049c-49cc-b174-c2dfe0095522 admin admin] PATH_INFO: `/v3/projects/d4c4b5b913274c66837cacbb31d863de/users/49763e9cdee14816ac1e6a3b89ea846e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:57.955609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb78ff3-049c-49cc-b174-c2dfe0095522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c4b5b913274c66837cacbb31d863de, user_id=49763e9cdee14816ac1e6a3b89ea846e, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:57.956655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-ceb78ff3-049c-49cc-b174-c2dfe0095522 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:18:57.956655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: warnings.warn(msg) Aug 10 11:18:57.956655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: Aug 10 11:18:57.958607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb78ff3-049c-49cc-b174-c2dfe0095522 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:58.079286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 752/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:18:57 2022] PUT /identity/v3/projects/d4c4b5b913274c66837cacbb31d863de/users/49763e9cdee14816ac1e6a3b89ea846e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:18:58.092182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571cf99-811b-4784-b357-6541705fd6eb None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:58.092508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571cf99-811b-4784-b357-6541705fd6eb None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:58.092784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571cf99-811b-4784-b357-6541705fd6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:58.149789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e571cf99-811b-4784-b357-6541705fd6eb None None] MFA Rules not processed for user `49763e9cdee14816ac1e6a3b89ea846e`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:58.151007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e571cf99-811b-4784-b357-6541705fd6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:58.227754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 750/1502] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:58.240775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84c51-1736-474b-8c68-4453cd5affc4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:58.241062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84c51-1736-474b-8c68-4453cd5affc4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:58.241336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84c51-1736-474b-8c68-4453cd5affc4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:58.242710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 753/1503] 10.222.0.40 () {54 vars in 964 bytes} [Wed Aug 10 11:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:18:58.247340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeff0d8-2ec0-4c74-ab59-ea6da2825571 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:58.247631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeff0d8-2ec0-4c74-ab59-ea6da2825571 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:58.247907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeff0d8-2ec0-4c74-ab59-ea6da2825571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:58.278830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:58.322527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-edeff0d8-2ec0-4c74-ab59-ea6da2825571 None None] MFA Rules not processed for user `65afb6f35528480591f2411976470d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:58.323763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-edeff0d8-2ec0-4c74-ab59-ea6da2825571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:58.399269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 751/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Aug 10 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:18:58.407283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc84c51-1736-474b-8c68-4453cd5affc4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:58.408817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4bc84c51-1736-474b-8c68-4453cd5affc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:58.459054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:58.512111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc84c51-1736-474b-8c68-4453cd5affc4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:58.583203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:58.583981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:58.584257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:58.584549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:58.586118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:58.684422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:58.685838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:58.689359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:58.703322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 754/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:18:58.749003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42db31-35f4-43c6-8e3b-b3c46e5cc8d3 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:58.749416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42db31-35f4-43c6-8e3b-b3c46e5cc8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:58.749567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42db31-35f4-43c6-8e3b-b3c46e5cc8d3 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:58.750815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 752/1506] 10.222.0.40 () {52 vars in 830 bytes} [Wed Aug 10 11:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 11:18:58.754330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:58.755603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:58.853056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c98e14-51c3-4a0b-a5e4-bad670a1f5e6 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:58.946715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:58.947341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:58.947618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:58.947887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] PATH_INFO: `/v3/users/49763e9cdee14816ac1e6a3b89ea846e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:58.959697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=49763e9cdee14816ac1e6a3b89ea846e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:58.960728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:18:58.960728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: warnings.warn(msg) Aug 10 11:18:58.960728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: Aug 10 11:18:58.961934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:58.971260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:59.137374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49763e9cdee14816ac1e6a3b89ea846e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:59.137824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49763e9cdee14816ac1e6a3b89ea846e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:59.219437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49763e9cdee14816ac1e6a3b89ea846e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:59.233975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49763e9cdee14816ac1e6a3b89ea846e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:59.256984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49763e9cdee14816ac1e6a3b89ea846e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:18:59.262563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 755/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:18:58 2022] DELETE /identity/v3/users/49763e9cdee14816ac1e6a3b89ea846e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:18:59.266940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635d96e-0fe9-437e-a598-bc24138b292d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:59.267319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635d96e-0fe9-437e-a598-bc24138b292d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:59.267689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635d96e-0fe9-437e-a598-bc24138b292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:59.325558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-b635d96e-0fe9-437e-a598-bc24138b292d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:18:59.326743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b635d96e-0fe9-437e-a598-bc24138b292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:59.403519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:59.415996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 753/1508] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:18:59.425672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:18:59.426902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:59.531236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea8a5a-7f95-491a-8edc-e99bd23f5e1d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:18:59.585477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:18:59.604706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101f45e-ead3-4daf-8a5d-9e0ea5ca6f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:18:59.605320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f45e-ead3-4daf-8a5d-9e0ea5ca6f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:18:59.605597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f45e-ead3-4daf-8a5d-9e0ea5ca6f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:18:59.605866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101f45e-ead3-4daf-8a5d-9e0ea5ca6f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:18:59.607503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0101f45e-ead3-4daf-8a5d-9e0ea5ca6f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:18:59.714926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101f45e-ead3-4daf-8a5d-9e0ea5ca6f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:18:59.716339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101f45e-ead3-4daf-8a5d-9e0ea5ca6f54 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:18:59.735501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 756/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:19:00.423627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635d96e-0fe9-437e-a598-bc24138b292d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:19:00.424878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b635d96e-0fe9-437e-a598-bc24138b292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:19:00.436468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635d96e-0fe9-437e-a598-bc24138b292d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:19:00.533823 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:19:00.534450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:19:00.534727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:19:00.534994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] PATH_INFO: `/v3/projects/d4c4b5b913274c66837cacbb31d863de` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:19:00.545235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c4b5b913274c66837cacbb31d863de)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:19:00.546245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING py.warnings [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:19:00.546245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: warnings.warn(msg) Aug 10 11:19:00.546245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: Aug 10 11:19:00.547424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:19:00.692344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c4b5b913274c66837cacbb31d863de', 'request_id': 'req-5e53a8a4-0b5e-44d0-af79-5201213d4224'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:19:00.706085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c4b5b913274c66837cacbb31d863de', 'request_id': 'req-5e53a8a4-0b5e-44d0-af79-5201213d4224'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:19:00.713156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c4b5b913274c66837cacbb31d863de', 'request_id': 'req-5e53a8a4-0b5e-44d0-af79-5201213d4224'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:19:00.792290 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] The token cache is being invalidate because project d4c4b5b913274c66837cacbb31d863de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:19:00.792629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:19:00.793149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5e53a8a4-0b5e-44d0-af79-5201213d4224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:19:00.794455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 754/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:19:00 2022] DELETE /identity/v3/projects/d4c4b5b913274c66837cacbb31d863de => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:19:09.733216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=62 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:19:10.790209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:36.131986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2aed-c407-482f-aeb3-cda661d6d83a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:36.132601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2aed-c407-482f-aeb3-cda661d6d83a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:36.132601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2aed-c407-482f-aeb3-cda661d6d83a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:36.133912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:20:36.138822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00d021-51bd-4363-a74b-bcbfbd78c152 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:36.139280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00d021-51bd-4363-a74b-bcbfbd78c152 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:36.139390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00d021-51bd-4363-a74b-bcbfbd78c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:36.222475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2e00d021-51bd-4363-a74b-bcbfbd78c152 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:20:36.224372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2e00d021-51bd-4363-a74b-bcbfbd78c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:36.325148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:20:36.479723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2aed-c407-482f-aeb3-cda661d6d83a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:36.481876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f43f2aed-c407-482f-aeb3-cda661d6d83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:36.598018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2aed-c407-482f-aeb3-cda661d6d83a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:36.603354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ec277-79ff-4d01-982a-18bda09a3db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:36.603949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec277-79ff-4d01-982a-18bda09a3db6 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:36.604227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec277-79ff-4d01-982a-18bda09a3db6 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:36.604535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec277-79ff-4d01-982a-18bda09a3db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:36.612324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ec277-79ff-4d01-982a-18bda09a3db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:36.613964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ec277-79ff-4d01-982a-18bda09a3db6 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:36.623002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 758/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:20:37.114288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041007-f93e-4e92-80c7-e9a981d56d47 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:37.114594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041007-f93e-4e92-80c7-e9a981d56d47 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:37.114946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041007-f93e-4e92-80c7-e9a981d56d47 None None] PATH_INFO: `/v3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:37.116468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 756/1514] 10.222.0.47 () {54 vars in 925 bytes} [Wed Aug 10 11:20:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:20:37.122571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232335-dfdd-489d-b78a-d31e3b59fb20 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:37.122857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232335-dfdd-489d-b78a-d31e3b59fb20 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:37.123132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00232335-dfdd-489d-b78a-d31e3b59fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:37.186158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-00232335-dfdd-489d-b78a-d31e3b59fb20 None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:20:37.187381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-00232335-dfdd-489d-b78a-d31e3b59fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:37.259358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:37.264712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 759/1515] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 10 11:20:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:20:37.453821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825fbb9-cc22-473d-8972-975633542291 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:37.454432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825fbb9-cc22-473d-8972-975633542291 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:37.454432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825fbb9-cc22-473d-8972-975633542291 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:37.455715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:20:37.461189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bd6e-0c45-43b6-9960-464e21d66fd2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:37.461473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bd6e-0c45-43b6-9960-464e21d66fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:37.461748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75bd6e-0c45-43b6-9960-464e21d66fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:37.481066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7c75bd6e-0c45-43b6-9960-464e21d66fd2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:20:37.482245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7c75bd6e-0c45-43b6-9960-464e21d66fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:37.490048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:20:37.638848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825fbb9-cc22-473d-8972-975633542291 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:37.653913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825fbb9-cc22-473d-8972-975633542291 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:37.659266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d442e-bf21-4206-8b06-cd76d6c8670d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:37.659855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d442e-bf21-4206-8b06-cd76d6c8670d service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:37.660134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d442e-bf21-4206-8b06-cd76d6c8670d service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:37.660994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d442e-bf21-4206-8b06-cd76d6c8670d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:37.668846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d442e-bf21-4206-8b06-cd76d6c8670d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:37.670416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d442e-bf21-4206-8b06-cd76d6c8670d service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:37.679409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 758/1518] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:20:46.185075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c08e-7145-44df-9163-4c4eb443012c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:46.185640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c08e-7145-44df-9163-4c4eb443012c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:46.185640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497c08e-7145-44df-9163-4c4eb443012c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:46.186937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 761/1519] 10.222.0.40 () {54 vars in 961 bytes} [Wed Aug 10 11:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:20:46.192421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2aea7-4f0d-4b1b-bf13-71d1ff013539 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:46.192837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2aea7-4f0d-4b1b-bf13-71d1ff013539 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:46.192963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2aea7-4f0d-4b1b-bf13-71d1ff013539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:46.212295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-65c2aea7-4f0d-4b1b-bf13-71d1ff013539 None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:20:46.213494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-65c2aea7-4f0d-4b1b-bf13-71d1ff013539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:46.221802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 759/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Aug 10 11:20:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:20:46.229399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c08e-7145-44df-9163-4c4eb443012c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:46.242648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497c08e-7145-44df-9163-4c4eb443012c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:46.247514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119c9fe-72e5-4440-856f-2ba0f20e7c5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:46.248091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c9fe-72e5-4440-856f-2ba0f20e7c5f service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:46.248397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c9fe-72e5-4440-856f-2ba0f20e7c5f service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:46.248674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c9fe-72e5-4440-856f-2ba0f20e7c5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:46.257392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119c9fe-72e5-4440-856f-2ba0f20e7c5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:46.258951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119c9fe-72e5-4440-856f-2ba0f20e7c5f service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:46.268595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 762/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:20:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:20:48.882382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f72e-695a-46b7-a045-6dcbd4143bc5 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:48.882936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f72e-695a-46b7-a045-6dcbd4143bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:48.882936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f72e-695a-46b7-a045-6dcbd4143bc5 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:48.884334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:20:48.889128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58ee62-1699-4275-acea-757ca5dd60c0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:48.889534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58ee62-1699-4275-acea-757ca5dd60c0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:48.889716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58ee62-1699-4275-acea-757ca5dd60c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:48.911399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2c58ee62-1699-4275-acea-757ca5dd60c0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:20:48.912598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c58ee62-1699-4275-acea-757ca5dd60c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:48.920359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:20:49.073802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1f72e-695a-46b7-a045-6dcbd4143bc5 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:49.088679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1f72e-695a-46b7-a045-6dcbd4143bc5 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:49.094075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe7199-ab22-4a2b-aa39-b6d082d02d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:49.094666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe7199-ab22-4a2b-aa39-b6d082d02d4f service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:49.094945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe7199-ab22-4a2b-aa39-b6d082d02d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:49.095217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe7199-ab22-4a2b-aa39-b6d082d02d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:49.103685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe7199-ab22-4a2b-aa39-b6d082d02d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:49.105278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe7199-ab22-4a2b-aa39-b6d082d02d4f service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:49.114586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 761/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:20:49.928371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd3dc-2f30-486a-86d8-872e0750f169 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:49.928948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd3dc-2f30-486a-86d8-872e0750f169 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:49.928948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bd3dc-2f30-486a-86d8-872e0750f169 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:49.930224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 11:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:20:49.935088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f1ee-8f03-49c8-8c79-924e0daea6f6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:49.935558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f1ee-8f03-49c8-8c79-924e0daea6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:49.935654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133f1ee-8f03-49c8-8c79-924e0daea6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:49.955099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a133f1ee-8f03-49c8-8c79-924e0daea6f6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:20:49.956286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a133f1ee-8f03-49c8-8c79-924e0daea6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:49.964792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 11:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:20:50.119873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd3dc-2f30-486a-86d8-872e0750f169 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:50.134269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bd3dc-2f30-486a-86d8-872e0750f169 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:50.139797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016131e-5ba8-4e41-9e77-ec498dd5bf0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:50.140431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016131e-5ba8-4e41-9e77-ec498dd5bf0f service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:50.140722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016131e-5ba8-4e41-9e77-ec498dd5bf0f service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:50.140998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016131e-5ba8-4e41-9e77-ec498dd5bf0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:50.149785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016131e-5ba8-4e41-9e77-ec498dd5bf0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:50.151367 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016131e-5ba8-4e41-9e77-ec498dd5bf0f service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:50.161545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 765/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:20:54.515218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021180c-0eaf-465a-bef7-5404b66dccb9 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:54.515794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021180c-0eaf-465a-bef7-5404b66dccb9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:54.515794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021180c-0eaf-465a-bef7-5404b66dccb9 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:54.517181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:20:54.522414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63d661-e898-485d-8f02-774e3da04e4b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:54.522849 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63d661-e898-485d-8f02-774e3da04e4b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:54.522967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63d661-e898-485d-8f02-774e3da04e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:54.543701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8b63d661-e898-485d-8f02-774e3da04e4b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:20:54.544920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8b63d661-e898-485d-8f02-774e3da04e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:54.553562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:20:54.626187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021180c-0eaf-465a-bef7-5404b66dccb9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:54.627879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b021180c-0eaf-465a-bef7-5404b66dccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:54.660261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:54.705028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021180c-0eaf-465a-bef7-5404b66dccb9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:54.709171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd6c6-843a-479d-b520-fdc77df289f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:54.709772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd6c6-843a-479d-b520-fdc77df289f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:54.710051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd6c6-843a-479d-b520-fdc77df289f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:54.710324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd6c6-843a-479d-b520-fdc77df289f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:54.719069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbd6c6-843a-479d-b520-fdc77df289f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:54.720521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbd6c6-843a-479d-b520-fdc77df289f8 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:54.730267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 764/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:20:56.811806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4bce-2f8e-46b9-b71f-b4395caab8bd None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:56.812393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4bce-2f8e-46b9-b71f-b4395caab8bd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:56.812393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4bce-2f8e-46b9-b71f-b4395caab8bd None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:56.813732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:20:56.820327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc01ae-aa7a-42c7-b198-8f2701842eeb None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:56.820819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc01ae-aa7a-42c7-b198-8f2701842eeb None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:56.820931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc01ae-aa7a-42c7-b198-8f2701842eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:56.841035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-23bc01ae-aa7a-42c7-b198-8f2701842eeb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:20:56.842232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-23bc01ae-aa7a-42c7-b198-8f2701842eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:20:56.850478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:20:56.886650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4bce-2f8e-46b9-b71f-b4395caab8bd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:20:56.898395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4bce-2f8e-46b9-b71f-b4395caab8bd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:20:56.902383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524af7e-80d7-41e7-a5e6-32360cdd86f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:20:56.902984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524af7e-80d7-41e7-a5e6-32360cdd86f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:20:56.903264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524af7e-80d7-41e7-a5e6-32360cdd86f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:20:56.903533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524af7e-80d7-41e7-a5e6-32360cdd86f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:20:56.912701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524af7e-80d7-41e7-a5e6-32360cdd86f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:20:56.914053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524af7e-80d7-41e7-a5e6-32360cdd86f0 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:20:56.923498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 768/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:21:00.969655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304827-945b-4898-8791-f6a5f2c5e893 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:21:00.970225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304827-945b-4898-8791-f6a5f2c5e893 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:21:00.970225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304827-945b-4898-8791-f6a5f2c5e893 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:21:00.971530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:21:00.977600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87fb78-ba7e-446b-83d3-79808375327c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:21:00.978038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87fb78-ba7e-446b-83d3-79808375327c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:21:00.978149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87fb78-ba7e-446b-83d3-79808375327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:21:00.998020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fc87fb78-ba7e-446b-83d3-79808375327c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:21:00.999269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fc87fb78-ba7e-446b-83d3-79808375327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:21:01.007027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:21:01.312692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304827-945b-4898-8791-f6a5f2c5e893 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:21:01.314359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c7304827-945b-4898-8791-f6a5f2c5e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:21:01.390075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304827-945b-4898-8791-f6a5f2c5e893 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:21:01.393615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc003-0f60-44ac-aa16-153159e97e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:21:01.394218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc003-0f60-44ac-aa16-153159e97e3f service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:21:01.394499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc003-0f60-44ac-aa16-153159e97e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:21:01.394772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc003-0f60-44ac-aa16-153159e97e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:21:01.403747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc003-0f60-44ac-aa16-153159e97e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:21:01.405195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc003-0f60-44ac-aa16-153159e97e3f service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:21:01.415036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 767/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:21:03.434999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca404-d9dc-4ec4-95c6-c1397b36abbd None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:21:03.435617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca404-d9dc-4ec4-95c6-c1397b36abbd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:21:03.435617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca404-d9dc-4ec4-95c6-c1397b36abbd None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:21:03.436942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 11:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:21:03.442439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c54c-fd03-428c-995d-f705d2ed7a35 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:21:03.442899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c54c-fd03-428c-995d-f705d2ed7a35 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:21:03.443005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c54c-fd03-428c-995d-f705d2ed7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:21:03.462420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ac89c54c-fd03-428c-995d-f705d2ed7a35 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:21:03.463587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ac89c54c-fd03-428c-995d-f705d2ed7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:21:03.471259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 11:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:21:03.772966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ca404-d9dc-4ec4-95c6-c1397b36abbd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:21:03.774863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-037ca404-d9dc-4ec4-95c6-c1397b36abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:21:03.787731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ca404-d9dc-4ec4-95c6-c1397b36abbd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:21:03.791155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690888e3-697b-4d27-ac25-bc74dcb6e5c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:21:03.791748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690888e3-697b-4d27-ac25-bc74dcb6e5c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:21:03.792024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690888e3-697b-4d27-ac25-bc74dcb6e5c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:21:03.792292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690888e3-697b-4d27-ac25-bc74dcb6e5c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:21:03.801616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690888e3-697b-4d27-ac25-bc74dcb6e5c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:21:03.803155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690888e3-697b-4d27-ac25-bc74dcb6e5c0 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:21:03.812565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 771/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:21:13.457209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=63 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:21:13.808389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=37 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:30.644791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43524d7a-b0c8-4715-a9a6-080ff37666ec None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:30.646105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43524d7a-b0c8-4715-a9a6-080ff37666ec None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:30.646594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43524d7a-b0c8-4715-a9a6-080ff37666ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:30.670095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-43524d7a-b0c8-4715-a9a6-080ff37666ec None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:30.673182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-43524d7a-b0c8-4715-a9a6-080ff37666ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:30.684321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 769/1540] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:30.693349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3a0f-72a4-470b-bb2b-9db541a9ec79 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:30.694430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3a0f-72a4-470b-bb2b-9db541a9ec79 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:30.695027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb3a0f-72a4-470b-bb2b-9db541a9ec79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:30.720483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f2eb3a0f-72a4-470b-bb2b-9db541a9ec79 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:30.725926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f2eb3a0f-72a4-470b-bb2b-9db541a9ec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:30.732684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 772/1541] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:30.737937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43524d7a-b0c8-4715-a9a6-080ff37666ec None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:30.750409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43524d7a-b0c8-4715-a9a6-080ff37666ec None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:30.759590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:30.760220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:30.760528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:30.760797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:30.761706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:30.762130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:30.763801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:30.781000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 770/1542] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:30.789718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3a0f-72a4-470b-bb2b-9db541a9ec79 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:30.804913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb3a0f-72a4-470b-bb2b-9db541a9ec79 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:30.819278 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc95da-9bf8-4af4-b0e2-b1af181048c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:30.820350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc95da-9bf8-4af4-b0e2-b1af181048c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:30.820862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc95da-9bf8-4af4-b0e2-b1af181048c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:30.821354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc95da-9bf8-4af4-b0e2-b1af181048c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:30.822225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc95da-9bf8-4af4-b0e2-b1af181048c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:30.824381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc95da-9bf8-4af4-b0e2-b1af181048c9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:30.952919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 773/1543] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:30 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:30.957770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:30.981105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b00704-540f-44fb-a810-76b6f3b63eab admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.065369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b3636-a59c-48a1-bac3-6623388c0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.066300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3636-a59c-48a1-bac3-6623388c0336 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.066741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3636-a59c-48a1-bac3-6623388c0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.067270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3636-a59c-48a1-bac3-6623388c0336 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.068066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b3636-a59c-48a1-bac3-6623388c0336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.070625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b3636-a59c-48a1-bac3-6623388c0336 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.177297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 771/1544] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:30 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:31.181287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc95da-9bf8-4af4-b0e2-b1af181048c9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.198124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc95da-9bf8-4af4-b0e2-b1af181048c9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.208865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4f97a-7272-46fb-a04f-cb90fa8d79c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.209432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f97a-7272-46fb-a04f-cb90fa8d79c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.209710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f97a-7272-46fb-a04f-cb90fa8d79c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.209983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4f97a-7272-46fb-a04f-cb90fa8d79c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.210639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f97a-7272-46fb-a04f-cb90fa8d79c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.212236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4f97a-7272-46fb-a04f-cb90fa8d79c5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.223248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 774/1545] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:22:31.227739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b3636-a59c-48a1-bac3-6623388c0336 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.243731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b3636-a59c-48a1-bac3-6623388c0336 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.252133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d3cca-9c49-49d4-a951-ab33511b9774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.253278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3cca-9c49-49d4-a951-ab33511b9774 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.253747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3cca-9c49-49d4-a951-ab33511b9774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.254245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3cca-9c49-49d4-a951-ab33511b9774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.255195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d3cca-9c49-49d4-a951-ab33511b9774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.256296 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c5003-bac2-4c04-bee5-6368613c4b9b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.256602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c5003-bac2-4c04-bee5-6368613c4b9b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.256881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c5003-bac2-4c04-bee5-6368613c4b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.258099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d3cca-9c49-49d4-a951-ab33511b9774 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.274853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 772/1546] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:31.278756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d3cca-9c49-49d4-a951-ab33511b9774 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.292323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d3cca-9c49-49d4-a951-ab33511b9774 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.301636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ce9c5003-bac2-4c04-bee5-6368613c4b9b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.302906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58068f1b-4422-499e-abe7-78b8f1b2e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.303059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ce9c5003-bac2-4c04-bee5-6368613c4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.303955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068f1b-4422-499e-abe7-78b8f1b2e300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.304484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068f1b-4422-499e-abe7-78b8f1b2e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.304978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068f1b-4422-499e-abe7-78b8f1b2e300 admin admin] PATH_INFO: `/v3/projects/8405cb3e2f8544d59641c3747ccab03d/users/f5dde9abd0df458f80b764500c0939c3/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.324342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 775/1547] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:22:31.324566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f03b-7304-4bbd-b5ab-507d7c15c8fb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.324830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f03b-7304-4bbd-b5ab-507d7c15c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.325109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2f03b-7304-4bbd-b5ab-507d7c15c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.333150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58068f1b-4422-499e-abe7-78b8f1b2e300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8405cb3e2f8544d59641c3747ccab03d, user_id=f5dde9abd0df458f80b764500c0939c3, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.334195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING py.warnings [None req-58068f1b-4422-499e-abe7-78b8f1b2e300 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:22:31.334195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: warnings.warn(msg) Aug 10 11:22:31.334195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: Aug 10 11:22:31.336111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58068f1b-4422-499e-abe7-78b8f1b2e300 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.353845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-85d2f03b-7304-4bbd-b5ab-507d7c15c8fb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.355166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-85d2f03b-7304-4bbd-b5ab-507d7c15c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.369562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 776/1548] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.370905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbc388-7441-497b-a0cf-8ccb787611cb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.371197 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbc388-7441-497b-a0cf-8ccb787611cb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.371468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbc388-7441-497b-a0cf-8ccb787611cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.395236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-92fbc388-7441-497b-a0cf-8ccb787611cb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.396778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-92fbc388-7441-497b-a0cf-8ccb787611cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.404619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 777/1549] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.405785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cb3ca-d703-4f8e-b997-6c2bce369a45 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.406120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cb3ca-d703-4f8e-b997-6c2bce369a45 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.406396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cb3ca-d703-4f8e-b997-6c2bce369a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.419818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 773/1550] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:31 2022] PUT /identity/v3/projects/8405cb3e2f8544d59641c3747ccab03d/users/f5dde9abd0df458f80b764500c0939c3/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:22:31.421625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20542e33-3a6b-4ee4-964c-f625b3e5146a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.422170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20542e33-3a6b-4ee4-964c-f625b3e5146a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.422971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20542e33-3a6b-4ee4-964c-f625b3e5146a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.427310 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a91cb3ca-d703-4f8e-b997-6c2bce369a45 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.428639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a91cb3ca-d703-4f8e-b997-6c2bce369a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.445103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-20542e33-3a6b-4ee4-964c-f625b3e5146a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.446300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-20542e33-3a6b-4ee4-964c-f625b3e5146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.496734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 778/1551] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.498137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e17a-4db9-4f44-8f8e-503b3adbe3fc None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.498257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e17a-4db9-4f44-8f8e-503b3adbe3fc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.498499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e17a-4db9-4f44-8f8e-503b3adbe3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.507663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 774/1552] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.508968 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f253a-0387-4713-bb7c-1d783fc5afbc None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.509250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f253a-0387-4713-bb7c-1d783fc5afbc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.509517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f253a-0387-4713-bb7c-1d783fc5afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.523171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-18c5e17a-4db9-4f44-8f8e-503b3adbe3fc None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.524492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-18c5e17a-4db9-4f44-8f8e-503b3adbe3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.528955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-390f253a-0387-4713-bb7c-1d783fc5afbc None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.530104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-390f253a-0387-4713-bb7c-1d783fc5afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.532840 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 779/1553] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.534166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649208-5a6d-4cd0-9194-06e82e61b9c3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.534452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649208-5a6d-4cd0-9194-06e82e61b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.534722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649208-5a6d-4cd0-9194-06e82e61b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.543820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 775/1554] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.545129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d527ee-bd70-4afc-a42b-77cf0a56a0b6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.545420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d527ee-bd70-4afc-a42b-77cf0a56a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.545683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d527ee-bd70-4afc-a42b-77cf0a56a0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.557230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-71649208-5a6d-4cd0-9194-06e82e61b9c3 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.558821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-71649208-5a6d-4cd0-9194-06e82e61b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.566831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-02d527ee-bd70-4afc-a42b-77cf0a56a0b6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.567459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 780/1555] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.568168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-02d527ee-bd70-4afc-a42b-77cf0a56a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.568679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216d45c-2acb-40fc-95d5-5155b2a763d9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.568958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216d45c-2acb-40fc-95d5-5155b2a763d9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.569223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216d45c-2acb-40fc-95d5-5155b2a763d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.581307 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 776/1556] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.585529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb724de-f5c4-4206-8338-1be29bc87ca6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.585529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb724de-f5c4-4206-8338-1be29bc87ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.585529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb724de-f5c4-4206-8338-1be29bc87ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.598236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d216d45c-2acb-40fc-95d5-5155b2a763d9 None None] MFA Rules not processed for user `f5dde9abd0df458f80b764500c0939c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.599478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d216d45c-2acb-40fc-95d5-5155b2a763d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.605825 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-beb724de-f5c4-4206-8338-1be29bc87ca6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.606995 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-beb724de-f5c4-4206-8338-1be29bc87ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.615877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 777/1557] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.617132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c6ee-071d-4ae1-9caa-d957c40ffdc3 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.619083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c6ee-071d-4ae1-9caa-d957c40ffdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.619083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8c6ee-071d-4ae1-9caa-d957c40ffdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.637220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-9da8c6ee-071d-4ae1-9caa-d957c40ffdc3 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.638493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9da8c6ee-071d-4ae1-9caa-d957c40ffdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.649144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 778/1558] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.650261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8c6ee-071d-4ae1-9caa-d957c40ffdc3 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.660399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8c6ee-071d-4ae1-9caa-d957c40ffdc3 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.665088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9ee38-fc80-4c52-a435-9d8fa07b682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.665580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9ee38-fc80-4c52-a435-9d8fa07b682e admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.665859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9ee38-fc80-4c52-a435-9d8fa07b682e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.666128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9ee38-fc80-4c52-a435-9d8fa07b682e admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.666761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9ee38-fc80-4c52-a435-9d8fa07b682e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:31.667063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9ee38-fc80-4c52-a435-9d8fa07b682e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.668690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9ee38-fc80-4c52-a435-9d8fa07b682e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.671249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:31.676580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 781/1559] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.676580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d21b42-800d-45c3-9735-85b8b9f5fc67 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.676580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d21b42-800d-45c3-9735-85b8b9f5fc67 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.676580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d21b42-800d-45c3-9735-85b8b9f5fc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.684619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 779/1560] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:31.686176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee470-08a3-4f23-b067-3e19871587a6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.686397 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee470-08a3-4f23-b067-3e19871587a6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.686627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee470-08a3-4f23-b067-3e19871587a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.698054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-37d21b42-800d-45c3-9735-85b8b9f5fc67 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.699512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-37d21b42-800d-45c3-9735-85b8b9f5fc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.707152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2a8ee470-08a3-4f23-b067-3e19871587a6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.707807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 782/1561] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.711035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2a8ee470-08a3-4f23-b067-3e19871587a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.711140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d21b42-800d-45c3-9735-85b8b9f5fc67 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.713590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:31.718301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 780/1562] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.718717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d21b42-800d-45c3-9735-85b8b9f5fc67 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.718959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ee470-08a3-4f23-b067-3e19871587a6 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.723871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741597e-d691-4cbc-bd41-c4d0ad48f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.724509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741597e-d691-4cbc-bd41-c4d0ad48f59b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.724804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741597e-d691-4cbc-bd41-c4d0ad48f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.725064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741597e-d691-4cbc-bd41-c4d0ad48f59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.725717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741597e-d691-4cbc-bd41-c4d0ad48f59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:31.726020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741597e-d691-4cbc-bd41-c4d0ad48f59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.727039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-f741597e-d691-4cbc-bd41-c4d0ad48f59b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:22:31.727039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: warnings.warn(msg) Aug 10 11:22:31.727039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: Aug 10 11:22:31.728056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741597e-d691-4cbc-bd41-c4d0ad48f59b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.728288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ee470-08a3-4f23-b067-3e19871587a6 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.733961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.734507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.735294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.735579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.736799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:31.737106 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.738692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.740864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 783/1563] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:31.742100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dbaf8-f32c-4b8a-b9a5-f52c4effcf79 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.742389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dbaf8-f32c-4b8a-b9a5-f52c4effcf79 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.742652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dbaf8-f32c-4b8a-b9a5-f52c4effcf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.751495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 781/1564] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:31.752442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.764065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a48dbaf8-f32c-4b8a-b9a5-f52c4effcf79 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:31.765289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a48dbaf8-f32c-4b8a-b9a5-f52c4effcf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:31.768232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af681-a109-4eb8-847f-5f2f5c2e1d80 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.772991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.773584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.773711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 784/1565] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:31.773953 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.774302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.774415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dbaf8-f32c-4b8a-b9a5-f52c4effcf79 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.775019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:31.775320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.776931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.789356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 782/1566] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:31.791428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.800561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9c0c5-4f95-434e-8061-5f9183d53ee8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.805207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.805787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.806071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.806338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.806973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.807974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING py.warnings [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:22:31.807974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: warnings.warn(msg) Aug 10 11:22:31.807974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: Aug 10 11:22:31.809326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.835322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dbaf8-f32c-4b8a-b9a5-f52c4effcf79 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.838984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed146-459c-4014-9efc-7baac1c90f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.839593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed146-459c-4014-9efc-7baac1c90f6e service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.839981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed146-459c-4014-9efc-7baac1c90f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.840258 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed146-459c-4014-9efc-7baac1c90f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.849060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed146-459c-4014-9efc-7baac1c90f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.851195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed146-459c-4014-9efc-7baac1c90f6e service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.859889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 785/1567] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:31.861285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed146-459c-4014-9efc-7baac1c90f6e service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.871168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed146-459c-4014-9efc-7baac1c90f6e service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.876764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.877406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.884457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.884457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.884457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:31.884457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.884457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.892159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 786/1568] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:31.893016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.903193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a625b51-e9ce-4e7f-90f4-93453f55dbde admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.908257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.908896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.909162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.909432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.910098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:31.910396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.911963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.925284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 787/1569] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:31.926080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:31.936048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc030-af5a-41c4-b087-8d5c4399bc70 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:31.941864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3512-259a-4ae9-bd2b-c859d82ca1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:31.942278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 783/1570] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:31.942481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3512-259a-4ae9-bd2b-c859d82ca1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:31.942838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3512-259a-4ae9-bd2b-c859d82ca1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:31.943083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f3512-259a-4ae9-bd2b-c859d82ca1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:31.943738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3512-259a-4ae9-bd2b-c859d82ca1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:31.945988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f3512-259a-4ae9-bd2b-c859d82ca1b9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:31.946196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.010044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca2bbc-34dd-460c-b81f-57399d37f79c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.014626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aa272-2544-4ca4-9206-359a258facab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.015236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aa272-2544-4ca4-9206-359a258facab admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.015515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aa272-2544-4ca4-9206-359a258facab admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.015792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aa272-2544-4ca4-9206-359a258facab admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.016662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39aa272-2544-4ca4-9206-359a258facab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.018481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39aa272-2544-4ca4-9206-359a258facab admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.040877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 788/1571] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.042097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3512-259a-4ae9-bd2b-c859d82ca1b9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.107642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f3512-259a-4ae9-bd2b-c859d82ca1b9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.113379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.113993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.114402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.114682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.115338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:32.115644 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.116838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 784/1572] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:31 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.117897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aa272-2544-4ca4-9206-359a258facab admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.120590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.133460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 789/1573] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:32.134282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.145866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1503db-87f7-49b4-a4c9-2ff3699cbc6b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.180976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:32.186429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aa272-2544-4ca4-9206-359a258facab admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.192581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564198e-a0cd-4e42-9342-20809d73c852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.192889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564198e-a0cd-4e42-9342-20809d73c852 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.193230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564198e-a0cd-4e42-9342-20809d73c852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.194172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564198e-a0cd-4e42-9342-20809d73c852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.194296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564198e-a0cd-4e42-9342-20809d73c852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.196183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564198e-a0cd-4e42-9342-20809d73c852 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.212023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f146-5ee5-4721-820b-2db898f688a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.212758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f146-5ee5-4721-820b-2db898f688a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.213336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f146-5ee5-4721-820b-2db898f688a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.213519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f146-5ee5-4721-820b-2db898f688a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.214165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016f146-5ee5-4721-820b-2db898f688a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.216395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016f146-5ee5-4721-820b-2db898f688a4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.290310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 785/1574] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.291177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564198e-a0cd-4e42-9342-20809d73c852 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.303736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:32.318114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 790/1575] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.318114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f146-5ee5-4721-820b-2db898f688a4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.357316 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564198e-a0cd-4e42-9342-20809d73c852 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.383723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f146-5ee5-4721-820b-2db898f688a4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.388737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.389356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.389681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.389963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.392595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.392595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:22:32.392595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: warnings.warn(msg) Aug 10 11:22:32.392595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: Aug 10 11:22:32.393008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.420516 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2529126-9638-4eeb-ab37-43a687b81825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.421168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529126-9638-4eeb-ab37-43a687b81825 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.421446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529126-9638-4eeb-ab37-43a687b81825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.421716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2529126-9638-4eeb-ab37-43a687b81825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.422879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2529126-9638-4eeb-ab37-43a687b81825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.424814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2529126-9638-4eeb-ab37-43a687b81825 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.460837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 791/1576] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.461644 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.473334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f308a-8c6f-4144-af19-3ac337215ec0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.477991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf5bf5-2e3e-465a-9fef-c661c3f934be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.478574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5bf5-2e3e-465a-9fef-c661c3f934be admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.483352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5bf5-2e3e-465a-9fef-c661c3f934be admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.483352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf5bf5-2e3e-465a-9fef-c661c3f934be admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.483352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf5bf5-2e3e-465a-9fef-c661c3f934be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.483352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf5bf5-2e3e-465a-9fef-c661c3f934be admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.502587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 786/1577] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.503395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2529126-9638-4eeb-ab37-43a687b81825 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.564581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 792/1578] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.566247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf5bf5-2e3e-465a-9fef-c661c3f934be admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.567205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2529126-9638-4eeb-ab37-43a687b81825 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.572005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede746e4-231e-4879-8564-b6b5015bd22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.572652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede746e4-231e-4879-8564-b6b5015bd22b admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.572930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede746e4-231e-4879-8564-b6b5015bd22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.573203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede746e4-231e-4879-8564-b6b5015bd22b admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.573832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede746e4-231e-4879-8564-b6b5015bd22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.575749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede746e4-231e-4879-8564-b6b5015bd22b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.576699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf5bf5-2e3e-465a-9fef-c661c3f934be admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.581544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e0d2d-06ce-42e2-a3ba-510d2147757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.585356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0d2d-06ce-42e2-a3ba-510d2147757d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.585356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0d2d-06ce-42e2-a3ba-510d2147757d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.585356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0d2d-06ce-42e2-a3ba-510d2147757d admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.585356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e0d2d-06ce-42e2-a3ba-510d2147757d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.585356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e0d2d-06ce-42e2-a3ba-510d2147757d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.684210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 787/1579] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.688630 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede746e4-231e-4879-8564-b6b5015bd22b admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.694934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede746e4-231e-4879-8564-b6b5015bd22b admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.699771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915918b7-0c48-4d1c-9a0e-18f86482c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.700408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915918b7-0c48-4d1c-9a0e-18f86482c1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.700691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915918b7-0c48-4d1c-9a0e-18f86482c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.701094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915918b7-0c48-4d1c-9a0e-18f86482c1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.701725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915918b7-0c48-4d1c-9a0e-18f86482c1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.703879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915918b7-0c48-4d1c-9a0e-18f86482c1f5 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.721375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 793/1580] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.721375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e0d2d-06ce-42e2-a3ba-510d2147757d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.788043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e0d2d-06ce-42e2-a3ba-510d2147757d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.792886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1286e0-9567-429f-8aab-77711894e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.793445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1286e0-9567-429f-8aab-77711894e659 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.793726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1286e0-9567-429f-8aab-77711894e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.794001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1286e0-9567-429f-8aab-77711894e659 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.794634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1286e0-9567-429f-8aab-77711894e659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.796625 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1286e0-9567-429f-8aab-77711894e659 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.808494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:32.822683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 788/1581] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.822683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915918b7-0c48-4d1c-9a0e-18f86482c1f5 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.831718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915918b7-0c48-4d1c-9a0e-18f86482c1f5 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.836456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230a85f-7bae-4672-811a-3084fa30bded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.837146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230a85f-7bae-4672-811a-3084fa30bded admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.837497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230a85f-7bae-4672-811a-3084fa30bded admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.837845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230a85f-7bae-4672-811a-3084fa30bded admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.838561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230a85f-7bae-4672-811a-3084fa30bded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.840216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230a85f-7bae-4672-811a-3084fa30bded admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.851477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 789/1582] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:32.852241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230a85f-7bae-4672-811a-3084fa30bded admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.858630 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:32.862570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230a85f-7bae-4672-811a-3084fa30bded admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.867748 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5411f8-8830-4eaf-a817-a8ce0ccee745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.868354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5411f8-8830-4eaf-a817-a8ce0ccee745 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.868640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5411f8-8830-4eaf-a817-a8ce0ccee745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.868910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5411f8-8830-4eaf-a817-a8ce0ccee745 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.869530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5411f8-8830-4eaf-a817-a8ce0ccee745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.871421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5411f8-8830-4eaf-a817-a8ce0ccee745 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.895100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 794/1583] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.897089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1286e0-9567-429f-8aab-77711894e659 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.905398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1286e0-9567-429f-8aab-77711894e659 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.910552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bce886-4228-4ac1-a2e7-43a9400e5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.911133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bce886-4228-4ac1-a2e7-43a9400e5587 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.911413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bce886-4228-4ac1-a2e7-43a9400e5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.911682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bce886-4228-4ac1-a2e7-43a9400e5587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.912336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bce886-4228-4ac1-a2e7-43a9400e5587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.913930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bce886-4228-4ac1-a2e7-43a9400e5587 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.924735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 795/1584] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:32.925892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bce886-4228-4ac1-a2e7-43a9400e5587 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.934905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bce886-4228-4ac1-a2e7-43a9400e5587 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.939758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb1c24-5a31-46de-a9a5-311dbb51ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.940347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb1c24-5a31-46de-a9a5-311dbb51ef6e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.940624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb1c24-5a31-46de-a9a5-311dbb51ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.940901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb1c24-5a31-46de-a9a5-311dbb51ef6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.941515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb1c24-5a31-46de-a9a5-311dbb51ef6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.943056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb1c24-5a31-46de-a9a5-311dbb51ef6e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.954669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 796/1585] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:32.955418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb1c24-5a31-46de-a9a5-311dbb51ef6e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.964376 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb1c24-5a31-46de-a9a5-311dbb51ef6e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.969998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceceb84-6654-40d3-a7f8-dabee31dac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:32.970572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceceb84-6654-40d3-a7f8-dabee31dac02 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:32.975378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceceb84-6654-40d3-a7f8-dabee31dac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:32.975378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceceb84-6654-40d3-a7f8-dabee31dac02 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:32.975378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceceb84-6654-40d3-a7f8-dabee31dac02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:32.975378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceceb84-6654-40d3-a7f8-dabee31dac02 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:32.978647 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 790/1586] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:32.979526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5411f8-8830-4eaf-a817-a8ce0ccee745 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:32.989629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5411f8-8830-4eaf-a817-a8ce0ccee745 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:32.994971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be922f-4287-4090-a5bf-65bd3e2138f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.000729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be922f-4287-4090-a5bf-65bd3e2138f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.000729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be922f-4287-4090-a5bf-65bd3e2138f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.000729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be922f-4287-4090-a5bf-65bd3e2138f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.000729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be922f-4287-4090-a5bf-65bd3e2138f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.000729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be922f-4287-4090-a5bf-65bd3e2138f8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.009903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 791/1587] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.010889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be922f-4287-4090-a5bf-65bd3e2138f8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.021137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be922f-4287-4090-a5bf-65bd3e2138f8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.025705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c58ecc-ea23-45fb-adff-7371a36caf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.026940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c58ecc-ea23-45fb-adff-7371a36caf1e admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.026940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c58ecc-ea23-45fb-adff-7371a36caf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.026940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c58ecc-ea23-45fb-adff-7371a36caf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.027421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c58ecc-ea23-45fb-adff-7371a36caf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.029091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c58ecc-ea23-45fb-adff-7371a36caf1e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.039454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 792/1588] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.040025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c58ecc-ea23-45fb-adff-7371a36caf1e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.052345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c58ecc-ea23-45fb-adff-7371a36caf1e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.052513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 797/1589] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:32 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:33.052513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceceb84-6654-40d3-a7f8-dabee31dac02 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.055600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c6c1-a7a6-4ef4-8c2b-e47bf7b7dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.056186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c6c1-a7a6-4ef4-8c2b-e47bf7b7dcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.056498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c6c1-a7a6-4ef4-8c2b-e47bf7b7dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.056771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c6c1-a7a6-4ef4-8c2b-e47bf7b7dcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.057400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552c6c1-a7a6-4ef4-8c2b-e47bf7b7dcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.058998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552c6c1-a7a6-4ef4-8c2b-e47bf7b7dcb8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.060219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceceb84-6654-40d3-a7f8-dabee31dac02 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.064821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576177d5-ded7-4117-ae12-9a0e8cc45788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.065413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576177d5-ded7-4117-ae12-9a0e8cc45788 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.065692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576177d5-ded7-4117-ae12-9a0e8cc45788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.065971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576177d5-ded7-4117-ae12-9a0e8cc45788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.066593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576177d5-ded7-4117-ae12-9a0e8cc45788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.068161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576177d5-ded7-4117-ae12-9a0e8cc45788 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.072032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 793/1590] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.072032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c6c1-a7a6-4ef4-8c2b-e47bf7b7dcb8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.080385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c6c1-a7a6-4ef4-8c2b-e47bf7b7dcb8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.085345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 798/1591] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.085345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576177d5-ded7-4117-ae12-9a0e8cc45788 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.087203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1d29d-c0e9-4ff4-885b-869c83d2da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.087855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1d29d-c0e9-4ff4-885b-869c83d2da33 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.088136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1d29d-c0e9-4ff4-885b-869c83d2da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.088449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1d29d-c0e9-4ff4-885b-869c83d2da33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.089094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1d29d-c0e9-4ff4-885b-869c83d2da33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.090839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1d29d-c0e9-4ff4-885b-869c83d2da33 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.093072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576177d5-ded7-4117-ae12-9a0e8cc45788 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.098407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02991-4efd-4330-ab76-f22b52b600e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.099027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02991-4efd-4330-ab76-f22b52b600e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.099420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02991-4efd-4330-ab76-f22b52b600e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.099713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02991-4efd-4330-ab76-f22b52b600e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.100569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec02991-4efd-4330-ab76-f22b52b600e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.102428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 794/1592] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.102783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec02991-4efd-4330-ab76-f22b52b600e3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.103229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1d29d-c0e9-4ff4-885b-869c83d2da33 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.113059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1d29d-c0e9-4ff4-885b-869c83d2da33 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.116720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 799/1593] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.116720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02991-4efd-4330-ab76-f22b52b600e3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.118045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276f64-73de-4ce0-95a1-ac3a66e39e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.118640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276f64-73de-4ce0-95a1-ac3a66e39e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.118919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276f64-73de-4ce0-95a1-ac3a66e39e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.119189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276f64-73de-4ce0-95a1-ac3a66e39e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.119821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06276f64-73de-4ce0-95a1-ac3a66e39e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.121463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06276f64-73de-4ce0-95a1-ac3a66e39e0e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.124722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02991-4efd-4330-ab76-f22b52b600e3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.129341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a892ea-7313-4250-8378-01ecdb654ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.129972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a892ea-7313-4250-8378-01ecdb654ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.130250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a892ea-7313-4250-8378-01ecdb654ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.130518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a892ea-7313-4250-8378-01ecdb654ab8 admin admin] PATH_INFO: `/v3/projects/6a431ef0f1e64b5dab74781f44c610ca/users/d1bd70f21aed4b2bae45199a5901c00b/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.134672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 795/1594] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.134672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276f64-73de-4ce0-95a1-ac3a66e39e0e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.143834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276f64-73de-4ce0-95a1-ac3a66e39e0e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.146411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a892ea-7313-4250-8378-01ecdb654ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a431ef0f1e64b5dab74781f44c610ca, user_id=d1bd70f21aed4b2bae45199a5901c00b, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.148724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05928ed-045c-40c5-81fe-814e5fec5a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.149049 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a892ea-7313-4250-8378-01ecdb654ab8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.149314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05928ed-045c-40c5-81fe-814e5fec5a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.149621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05928ed-045c-40c5-81fe-814e5fec5a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.149897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05928ed-045c-40c5-81fe-814e5fec5a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.150559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05928ed-045c-40c5-81fe-814e5fec5a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.152131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05928ed-045c-40c5-81fe-814e5fec5a64 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.163178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 796/1595] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.166797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05928ed-045c-40c5-81fe-814e5fec5a64 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.173906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05928ed-045c-40c5-81fe-814e5fec5a64 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.178585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11854d7-673a-43d1-af55-87f718b1f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.179165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11854d7-673a-43d1-af55-87f718b1f32c admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.179445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11854d7-673a-43d1-af55-87f718b1f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.179718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11854d7-673a-43d1-af55-87f718b1f32c admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.180400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11854d7-673a-43d1-af55-87f718b1f32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.181966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11854d7-673a-43d1-af55-87f718b1f32c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.192244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 797/1596] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.197434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11854d7-673a-43d1-af55-87f718b1f32c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.202453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11854d7-673a-43d1-af55-87f718b1f32c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.207490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f823a1-f88a-4d60-8421-2fa3851fd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.208159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f823a1-f88a-4d60-8421-2fa3851fd099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.208475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f823a1-f88a-4d60-8421-2fa3851fd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.208753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f823a1-f88a-4d60-8421-2fa3851fd099 admin admin] PATH_INFO: `/v3/projects/309ab1da3426405fa8bf76ff81a2b459/users/79b7f521de1b418ca206d1948e00a748/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.222594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 800/1597] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:33 2022] PUT /identity/v3/projects/6a431ef0f1e64b5dab74781f44c610ca/users/d1bd70f21aed4b2bae45199a5901c00b/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:33.223651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f823a1-f88a-4d60-8421-2fa3851fd099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309ab1da3426405fa8bf76ff81a2b459, user_id=79b7f521de1b418ca206d1948e00a748, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.226385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f823a1-f88a-4d60-8421-2fa3851fd099 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.227047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a892ea-7313-4250-8378-01ecdb654ab8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.289481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a892ea-7313-4250-8378-01ecdb654ab8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.294038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b697849-a77d-407b-94d0-4c041dcd0326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.294695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b697849-a77d-407b-94d0-4c041dcd0326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.294975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b697849-a77d-407b-94d0-4c041dcd0326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.295247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b697849-a77d-407b-94d0-4c041dcd0326 admin admin] PATH_INFO: `/v3/projects/a89a79515c564e37bfed75c840c89488/users/693a882910884fb0bfea9e4dd6e0619d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.300588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 798/1598] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:33 2022] PUT /identity/v3/projects/309ab1da3426405fa8bf76ff81a2b459/users/79b7f521de1b418ca206d1948e00a748/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:33.301531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f823a1-f88a-4d60-8421-2fa3851fd099 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.317323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b697849-a77d-407b-94d0-4c041dcd0326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89a79515c564e37bfed75c840c89488, user_id=693a882910884fb0bfea9e4dd6e0619d, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.318646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b697849-a77d-407b-94d0-4c041dcd0326 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.363319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f823a1-f88a-4d60-8421-2fa3851fd099 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.367739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe79e5b-44f3-4949-af29-ee76c07e8e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.368362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe79e5b-44f3-4949-af29-ee76c07e8e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.368686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe79e5b-44f3-4949-af29-ee76c07e8e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.368951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe79e5b-44f3-4949-af29-ee76c07e8e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.369586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe79e5b-44f3-4949-af29-ee76c07e8e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.371170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe79e5b-44f3-4949-af29-ee76c07e8e46 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.381281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 799/1599] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.382170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe79e5b-44f3-4949-af29-ee76c07e8e46 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.392014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe79e5b-44f3-4949-af29-ee76c07e8e46 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.398798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 801/1600] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:33 2022] PUT /identity/v3/projects/a89a79515c564e37bfed75c840c89488/users/693a882910884fb0bfea9e4dd6e0619d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:33.411045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b697849-a77d-407b-94d0-4c041dcd0326 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.432750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:33.448971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6597bf-a11f-42a4-b9aa-c33b9945a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.449636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6597bf-a11f-42a4-b9aa-c33b9945a15e admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.449916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6597bf-a11f-42a4-b9aa-c33b9945a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.450186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6597bf-a11f-42a4-b9aa-c33b9945a15e admin admin] PATH_INFO: `/v3/projects/b6eb8e1e92854f0db8837459a7058eeb/users/9713207bf34847ae8faf498fc96061e2/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.463301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:33.465350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6597bf-a11f-42a4-b9aa-c33b9945a15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6eb8e1e92854f0db8837459a7058eeb, user_id=9713207bf34847ae8faf498fc96061e2, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.468010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6597bf-a11f-42a4-b9aa-c33b9945a15e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.473634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b697849-a77d-407b-94d0-4c041dcd0326 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.478353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef09c5-1a1e-4afe-8625-fa4a1dd8576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.478956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef09c5-1a1e-4afe-8625-fa4a1dd8576d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.479237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef09c5-1a1e-4afe-8625-fa4a1dd8576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.479510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef09c5-1a1e-4afe-8625-fa4a1dd8576d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.480153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef09c5-1a1e-4afe-8625-fa4a1dd8576d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.481759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef09c5-1a1e-4afe-8625-fa4a1dd8576d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.491298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 802/1601] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:33.492058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef09c5-1a1e-4afe-8625-fa4a1dd8576d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.501915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef09c5-1a1e-4afe-8625-fa4a1dd8576d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.506515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dc463-e7cc-4cc5-a4f1-eac75ef19714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.507134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc463-e7cc-4cc5-a4f1-eac75ef19714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.507415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc463-e7cc-4cc5-a4f1-eac75ef19714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.507691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc463-e7cc-4cc5-a4f1-eac75ef19714 admin admin] PATH_INFO: `/v3/projects/dc16f7eefdde47edafa81f2390554940/users/732e7072abde49de887256b43707c0b9/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.522664 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dc463-e7cc-4cc5-a4f1-eac75ef19714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc16f7eefdde47edafa81f2390554940, user_id=732e7072abde49de887256b43707c0b9, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.527533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dc463-e7cc-4cc5-a4f1-eac75ef19714 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.552256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 800/1602] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:33 2022] PUT /identity/v3/projects/b6eb8e1e92854f0db8837459a7058eeb/users/9713207bf34847ae8faf498fc96061e2/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:33.556073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660bce-c929-4136-9ec0-2a6e992b2971 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.556073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660bce-c929-4136-9ec0-2a6e992b2971 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.556073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660bce-c929-4136-9ec0-2a6e992b2971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.572774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5a660bce-c929-4136-9ec0-2a6e992b2971 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:33.573926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5a660bce-c929-4136-9ec0-2a6e992b2971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:33.609488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 803/1603] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:33 2022] PUT /identity/v3/projects/dc16f7eefdde47edafa81f2390554940/users/732e7072abde49de887256b43707c0b9/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:33.610762 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea79bb-1fc0-4dcf-9b74-738546308dfb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.611064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea79bb-1fc0-4dcf-9b74-738546308dfb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.611325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea79bb-1fc0-4dcf-9b74-738546308dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.632916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 801/1604] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:33.633802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660bce-c929-4136-9ec0-2a6e992b2971 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.639570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-41ea79bb-1fc0-4dcf-9b74-738546308dfb None None] MFA Rules not processed for user `79b7f521de1b418ca206d1948e00a748`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:33.640867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-41ea79bb-1fc0-4dcf-9b74-738546308dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:33.644235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660bce-c929-4136-9ec0-2a6e992b2971 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.699016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f3ed6-d1e5-4980-81cf-ae80381fe05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.699907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3ed6-d1e5-4980-81cf-ae80381fe05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.700010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3ed6-d1e5-4980-81cf-ae80381fe05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.700225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3ed6-d1e5-4980-81cf-ae80381fe05c admin admin] PATH_INFO: `/v3/projects/79b8312155724fd2aaf494f06a6241ec/users/8bdb4c1d97ec4212ab56e8be7ff879ff/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.709480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 804/1605] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:33.710891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b69a-4582-4b3d-857a-8b1294e99b17 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.711199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b69a-4582-4b3d-857a-8b1294e99b17 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.711488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7b69a-4582-4b3d-857a-8b1294e99b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.721597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f3ed6-d1e5-4980-81cf-ae80381fe05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b8312155724fd2aaf494f06a6241ec, user_id=8bdb4c1d97ec4212ab56e8be7ff879ff, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.724232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f3ed6-d1e5-4980-81cf-ae80381fe05c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.741015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-46b7b69a-4582-4b3d-857a-8b1294e99b17 None None] MFA Rules not processed for user `693a882910884fb0bfea9e4dd6e0619d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:33.742208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-46b7b69a-4582-4b3d-857a-8b1294e99b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:33.800838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 802/1606] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:33 2022] PUT /identity/v3/projects/79b8312155724fd2aaf494f06a6241ec/users/8bdb4c1d97ec4212ab56e8be7ff879ff/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:33.801821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f3ed6-d1e5-4980-81cf-ae80381fe05c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.819376 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 805/1607] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:33.821731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f087-e22a-4d93-aa9b-a0169e6231f3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.821731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f087-e22a-4d93-aa9b-a0169e6231f3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.821731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f087-e22a-4d93-aa9b-a0169e6231f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.845003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a978f087-e22a-4d93-aa9b-a0169e6231f3 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:33.846823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a978f087-e22a-4d93-aa9b-a0169e6231f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:33.872512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:33.885637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f3ed6-d1e5-4980-81cf-ae80381fe05c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:33.889810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:33.891379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bf9e9-63af-4175-8604-6be5e8b7e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:33.892165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bf9e9-63af-4175-8604-6be5e8b7e329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.892476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bf9e9-63af-4175-8604-6be5e8b7e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.892746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bf9e9-63af-4175-8604-6be5e8b7e329 admin admin] PATH_INFO: `/v3/projects/824ae6855e7a48b4b4d7ce198f4ebd0d/users/cf8e97880404478b9ebaae2a03ab2428/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.907794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bf9e9-63af-4175-8604-6be5e8b7e329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824ae6855e7a48b4b4d7ce198f4ebd0d, user_id=cf8e97880404478b9ebaae2a03ab2428, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:33.917745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 806/1608] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:33.918034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bf9e9-63af-4175-8604-6be5e8b7e329 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:33.918120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac9de-96ee-4805-a593-b30cfbfbb5e1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:33.918120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac9de-96ee-4805-a593-b30cfbfbb5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:33.918120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac9de-96ee-4805-a593-b30cfbfbb5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:33.930973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-208ac9de-96ee-4805-a593-b30cfbfbb5e1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:33.940028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-208ac9de-96ee-4805-a593-b30cfbfbb5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:33.940221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 807/1609] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:33.941127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac9de-96ee-4805-a593-b30cfbfbb5e1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:33.942350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-208ac9de-96ee-4805-a593-b30cfbfbb5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:33.998183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac9de-96ee-4805-a593-b30cfbfbb5e1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.003359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 803/1610] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:33 2022] PUT /identity/v3/projects/824ae6855e7a48b4b4d7ce198f4ebd0d/users/cf8e97880404478b9ebaae2a03ab2428/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:34.004720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64513f5-9d4b-4b91-83eb-995eac917629 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.004993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64513f5-9d4b-4b91-83eb-995eac917629 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.005291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64513f5-9d4b-4b91-83eb-995eac917629 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.006507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 804/1611] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 10 11:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:22:34.007490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af11d-5ca0-41a6-ae17-20d1fcdff0ae None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.007773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af11d-5ca0-41a6-ae17-20d1fcdff0ae None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.008036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af11d-5ca0-41a6-ae17-20d1fcdff0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.031546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-3e6af11d-5ca0-41a6-ae17-20d1fcdff0ae None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:34.033389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3e6af11d-5ca0-41a6-ae17-20d1fcdff0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:34.054800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075744be-a778-4f92-8a7b-b70fd4d740d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.055422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075744be-a778-4f92-8a7b-b70fd4d740d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.055707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075744be-a778-4f92-8a7b-b70fd4d740d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.055987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075744be-a778-4f92-8a7b-b70fd4d740d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.095048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 805/1612] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:34.095048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af69417-6767-4b1d-b3c6-09e72cd548fb None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.095048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af69417-6767-4b1d-b3c6-09e72cd548fb None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.095048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af69417-6767-4b1d-b3c6-09e72cd548fb None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.095478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 806/1613] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 10 11:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:22:34.096099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af69417-6767-4b1d-b3c6-09e72cd548fb None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.107330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af69417-6767-4b1d-b3c6-09e72cd548fb None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.110968 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e78e1-284c-403b-8df4-0cc7f94aa848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.111541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e78e1-284c-403b-8df4-0cc7f94aa848 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.111814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e78e1-284c-403b-8df4-0cc7f94aa848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.112087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e78e1-284c-403b-8df4-0cc7f94aa848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.119136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075744be-a778-4f92-8a7b-b70fd4d740d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.120770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075744be-a778-4f92-8a7b-b70fd4d740d1 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.120893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e78e1-284c-403b-8df4-0cc7f94aa848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.122252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e78e1-284c-403b-8df4-0cc7f94aa848 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.131062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 808/1614] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:34.132014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 807/1615] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:34.133678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075744be-a778-4f92-8a7b-b70fd4d740d1 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.133881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ded21-0dbb-4c1a-8469-88b49559aa3e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.134307 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ded21-0dbb-4c1a-8469-88b49559aa3e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.134665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ded21-0dbb-4c1a-8469-88b49559aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.142756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075744be-a778-4f92-8a7b-b70fd4d740d1 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.147816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61518e8f-d9c5-49b2-bdf2-bcd0e7bbfbb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.148459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61518e8f-d9c5-49b2-bdf2-bcd0e7bbfbb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.148743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61518e8f-d9c5-49b2-bdf2-bcd0e7bbfbb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.149017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61518e8f-d9c5-49b2-bdf2-bcd0e7bbfbb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.160141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61518e8f-d9c5-49b2-bdf2-bcd0e7bbfbb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.162353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61518e8f-d9c5-49b2-bdf2-bcd0e7bbfbb2 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.173476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 809/1616] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:34.174623 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc502-e55e-4f36-ab72-3dd3c5695d85 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.175054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc502-e55e-4f36-ab72-3dd3c5695d85 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.175331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fc502-e55e-4f36-ab72-3dd3c5695d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.177403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-130ded21-0dbb-4c1a-8469-88b49559aa3e None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:34.178646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-130ded21-0dbb-4c1a-8469-88b49559aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:34.209264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b20fc502-e55e-4f36-ab72-3dd3c5695d85 None None] MFA Rules not processed for user `cf8e97880404478b9ebaae2a03ab2428`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:34.210474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b20fc502-e55e-4f36-ab72-3dd3c5695d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:34.250110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 808/1617] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 10 11:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:34.252410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736782-9613-403a-86b8-e247be100b47 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.252708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736782-9613-403a-86b8-e247be100b47 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.253080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736782-9613-403a-86b8-e247be100b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.274077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-28736782-9613-403a-86b8-e247be100b47 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:34.275409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-28736782-9613-403a-86b8-e247be100b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:34.278722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 810/1618] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:34.279711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fc502-e55e-4f36-ab72-3dd3c5695d85 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.289772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 809/1619] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 10 11:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:34.291297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fc502-e55e-4f36-ab72-3dd3c5695d85 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.295691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a868080-fcf3-49be-b103-a9efa7a4aec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.296401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868080-fcf3-49be-b103-a9efa7a4aec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.296710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868080-fcf3-49be-b103-a9efa7a4aec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.297260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868080-fcf3-49be-b103-a9efa7a4aec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.304010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28736782-9613-403a-86b8-e247be100b47 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.309000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a868080-fcf3-49be-b103-a9efa7a4aec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.311338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a868080-fcf3-49be-b103-a9efa7a4aec9 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.317651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28736782-9613-403a-86b8-e247be100b47 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.323448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 811/1620] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:34.324746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a868080-fcf3-49be-b103-a9efa7a4aec9 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.324975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1340-d15c-4cbe-8283-39577aaecdfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.325786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1340-d15c-4cbe-8283-39577aaecdfc service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.326159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1340-d15c-4cbe-8283-39577aaecdfc service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.326621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1340-d15c-4cbe-8283-39577aaecdfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.337885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a868080-fcf3-49be-b103-a9efa7a4aec9 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.344574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d08b01-7d34-4d2a-a6ed-3bef7cd01d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.345492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08b01-7d34-4d2a-a6ed-3bef7cd01d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.345869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08b01-7d34-4d2a-a6ed-3bef7cd01d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.346403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d08b01-7d34-4d2a-a6ed-3bef7cd01d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.347526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d08b01-7d34-4d2a-a6ed-3bef7cd01d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.350285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d08b01-7d34-4d2a-a6ed-3bef7cd01d89 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.394155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c1340-d15c-4cbe-8283-39577aaecdfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.396018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c1340-d15c-4cbe-8283-39577aaecdfc service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.405010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 810/1621] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:34.409695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1340-d15c-4cbe-8283-39577aaecdfc service nova] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.420721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1340-d15c-4cbe-8283-39577aaecdfc service nova] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.437193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 812/1622] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:34 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:34.439155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d08b01-7d34-4d2a-a6ed-3bef7cd01d89 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.442334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c71bc-48d8-4adb-8f5f-e98d6db933d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.442956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c71bc-48d8-4adb-8f5f-e98d6db933d0 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.443234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c71bc-48d8-4adb-8f5f-e98d6db933d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.443501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c71bc-48d8-4adb-8f5f-e98d6db933d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.455319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:34.518503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d08b01-7d34-4d2a-a6ed-3bef7cd01d89 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.530087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c0a7-b28b-4611-aba3-3f902fbc1608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.530554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c0a7-b28b-4611-aba3-3f902fbc1608 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.530967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c0a7-b28b-4611-aba3-3f902fbc1608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.531244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c0a7-b28b-4611-aba3-3f902fbc1608 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.531918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261c0a7-b28b-4611-aba3-3f902fbc1608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.533945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261c0a7-b28b-4611-aba3-3f902fbc1608 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.540251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:34.556458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c71bc-48d8-4adb-8f5f-e98d6db933d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.557991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c71bc-48d8-4adb-8f5f-e98d6db933d0 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.568839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 811/1623] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:34.611615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 813/1624] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:34 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:34.612589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c71bc-48d8-4adb-8f5f-e98d6db933d0 service nova] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.626260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c71bc-48d8-4adb-8f5f-e98d6db933d0 service nova] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.631314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bddf4-4444-4d80-ba9e-a97acf50a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.631981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bddf4-4444-4d80-ba9e-a97acf50a897 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.632357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bddf4-4444-4d80-ba9e-a97acf50a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.632619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bddf4-4444-4d80-ba9e-a97acf50a897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.633317 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bddf4-4444-4d80-ba9e-a97acf50a897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.634988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bddf4-4444-4d80-ba9e-a97acf50a897 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.646887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 812/1625] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:34.650572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c0a7-b28b-4611-aba3-3f902fbc1608 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.665538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c0a7-b28b-4611-aba3-3f902fbc1608 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.671536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6277d6-9232-49a9-9037-b842539e6eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.672922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6277d6-9232-49a9-9037-b842539e6eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.673207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6277d6-9232-49a9-9037-b842539e6eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.673487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6277d6-9232-49a9-9037-b842539e6eaa admin admin] PATH_INFO: `/v3/projects/83dc00d049354ec385ec8ed667425ef6/users/c59a13e274c449b0bfb3c8992f12bed8/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.681826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6ae7-c005-4f8d-bfaf-12bb12c5ca90 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.682413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6ae7-c005-4f8d-bfaf-12bb12c5ca90 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.682934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6ae7-c005-4f8d-bfaf-12bb12c5ca90 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.684818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 813/1626] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 10 11:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:22:34.691578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191f577-9c86-4e22-9e60-413a3a03a532 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.691960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191f577-9c86-4e22-9e60-413a3a03a532 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.692376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191f577-9c86-4e22-9e60-413a3a03a532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.694360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6277d6-9232-49a9-9037-b842539e6eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dc00d049354ec385ec8ed667425ef6, user_id=c59a13e274c449b0bfb3c8992f12bed8, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.699630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6277d6-9232-49a9-9037-b842539e6eaa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.715131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d191f577-9c86-4e22-9e60-413a3a03a532 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:34.716791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d191f577-9c86-4e22-9e60-413a3a03a532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:34.799383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 814/1627] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:22:34.814856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191f577-9c86-4e22-9e60-413a3a03a532 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.841507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 814/1628] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:34 2022] PUT /identity/v3/projects/83dc00d049354ec385ec8ed667425ef6/users/c59a13e274c449b0bfb3c8992f12bed8/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:34.842991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c3a2-7417-4fbd-9a85-ab7056982591 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.843302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c3a2-7417-4fbd-9a85-ab7056982591 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.843527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c3a2-7417-4fbd-9a85-ab7056982591 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.845681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 815/1629] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 10 11:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:22:34.846396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c3a2-7417-4fbd-9a85-ab7056982591 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:34.894152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:34.899215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191f577-9c86-4e22-9e60-413a3a03a532 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.910671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:34.926487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8c3a2-7417-4fbd-9a85-ab7056982591 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:34.932167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea018f3-f84e-4424-b0f0-b7d51aa09629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.933088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea018f3-f84e-4424-b0f0-b7d51aa09629 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.936441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea018f3-f84e-4424-b0f0-b7d51aa09629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.936441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea018f3-f84e-4424-b0f0-b7d51aa09629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.936441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea018f3-f84e-4424-b0f0-b7d51aa09629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:34.936441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea018f3-f84e-4424-b0f0-b7d51aa09629 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:34.951705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 816/1630] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:34.953181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82aa00-bcdb-45fb-88e2-a49d4aa63d8e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.954403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82aa00-bcdb-45fb-88e2-a49d4aa63d8e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.954727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82aa00-bcdb-45fb-88e2-a49d4aa63d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.957839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5da4-e3ae-4238-86f5-b5a1bb25e04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:34.958484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5da4-e3ae-4238-86f5-b5a1bb25e04a service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:34.958761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5da4-e3ae-4238-86f5-b5a1bb25e04a service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:34.959039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5da4-e3ae-4238-86f5-b5a1bb25e04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:34.974446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0c82aa00-bcdb-45fb-88e2-a49d4aa63d8e None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:34.975664 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0c82aa00-bcdb-45fb-88e2-a49d4aa63d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:35.037863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5da4-e3ae-4238-86f5-b5a1bb25e04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:35.039331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5da4-e3ae-4238-86f5-b5a1bb25e04a service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:35.052498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 815/1631] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:22:35.053830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5da4-e3ae-4238-86f5-b5a1bb25e04a service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:35.065438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5da4-e3ae-4238-86f5-b5a1bb25e04a service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:35.066468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 817/1632] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:35.073959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135181c-9335-4241-b9b8-3558803f3757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:35.073959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135181c-9335-4241-b9b8-3558803f3757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:35.073959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135181c-9335-4241-b9b8-3558803f3757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:35.073959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135181c-9335-4241-b9b8-3558803f3757 admin admin] PATH_INFO: `/v3/projects/83dc00d049354ec385ec8ed667425ef6/users/c59a13e274c449b0bfb3c8992f12bed8/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:35.075150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135181c-9335-4241-b9b8-3558803f3757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dc00d049354ec385ec8ed667425ef6, user_id=c59a13e274c449b0bfb3c8992f12bed8, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:35.079018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135181c-9335-4241-b9b8-3558803f3757 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:35.083820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82aa00-bcdb-45fb-88e2-a49d4aa63d8e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:35.094230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 816/1633] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:35 2022] PUT /identity/v3/projects/83dc00d049354ec385ec8ed667425ef6/users/c59a13e274c449b0bfb3c8992f12bed8/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:35.105503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82aa00-bcdb-45fb-88e2-a49d4aa63d8e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:35.108070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2f3b3-b2db-416f-b79b-5596bcabefd7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:35.108070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2f3b3-b2db-416f-b79b-5596bcabefd7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:35.108070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2f3b3-b2db-416f-b79b-5596bcabefd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:35.170208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-26c2f3b3-b2db-416f-b79b-5596bcabefd7 None None] MFA Rules not processed for user `c59a13e274c449b0bfb3c8992f12bed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:35.177046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-26c2f3b3-b2db-416f-b79b-5596bcabefd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:35.183120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ac78-bd5a-412e-ad09-3799a4d85333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:35.183856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ac78-bd5a-412e-ad09-3799a4d85333 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:35.184236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ac78-bd5a-412e-ad09-3799a4d85333 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:35.184665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ac78-bd5a-412e-ad09-3799a4d85333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:35.273483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74ac78-bd5a-412e-ad09-3799a4d85333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:35.275692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74ac78-bd5a-412e-ad09-3799a4d85333 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:35.288747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 818/1634] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:35.296566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 817/1635] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:35.355708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ac78-bd5a-412e-ad09-3799a4d85333 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:35.372935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ac78-bd5a-412e-ad09-3799a4d85333 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:35.394386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17851bb0-c24b-44f6-a30f-03d7257a3b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:35.395021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17851bb0-c24b-44f6-a30f-03d7257a3b38 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:35.395301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17851bb0-c24b-44f6-a30f-03d7257a3b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:35.395828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17851bb0-c24b-44f6-a30f-03d7257a3b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:35.408649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17851bb0-c24b-44f6-a30f-03d7257a3b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:35.410589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17851bb0-c24b-44f6-a30f-03d7257a3b38 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:35.424288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 819/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:36.684226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2f3b3-b2db-416f-b79b-5596bcabefd7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:36.684226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2f3b3-b2db-416f-b79b-5596bcabefd7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:36.684226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d552e-91c0-4e8d-bf5b-5d539476f49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:36.684226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d552e-91c0-4e8d-bf5b-5d539476f49e service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:36.699034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d552e-91c0-4e8d-bf5b-5d539476f49e service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:36.699034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d552e-91c0-4e8d-bf5b-5d539476f49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:36.699034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:36.702583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17851bb0-c24b-44f6-a30f-03d7257a3b38 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:36.702583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:36.708158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d552e-91c0-4e8d-bf5b-5d539476f49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:36.708158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d552e-91c0-4e8d-bf5b-5d539476f49e service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:36.708158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 818/1637] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:36.739906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17851bb0-c24b-44f6-a30f-03d7257a3b38 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:36.739906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:36.739906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:36.739906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:36.742234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] PATH_INFO: `/v3/users/693a882910884fb0bfea9e4dd6e0619d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:36.742234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693a882910884fb0bfea9e4dd6e0619d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:36.742234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:36.960604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693a882910884fb0bfea9e4dd6e0619d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:36.961340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693a882910884fb0bfea9e4dd6e0619d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:37.025717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693a882910884fb0bfea9e4dd6e0619d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:37.037741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693a882910884fb0bfea9e4dd6e0619d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:37.061167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693a882910884fb0bfea9e4dd6e0619d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:37.068726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 820/1638] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:22:36 2022] DELETE /identity/v3/users/693a882910884fb0bfea9e4dd6e0619d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:22:37.073452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04122dd-2f2f-4efa-acdb-526cc51385db None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:37.074175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04122dd-2f2f-4efa-acdb-526cc51385db None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:37.074567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04122dd-2f2f-4efa-acdb-526cc51385db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:37.095583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c04122dd-2f2f-4efa-acdb-526cc51385db None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:37.096959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c04122dd-2f2f-4efa-acdb-526cc51385db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:37.206654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 819/1639] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:37.219262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:37.220832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:37.332651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e271ec0-f4ad-44de-abc2-13f80db892f7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:37.337642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bfc59-d5a0-43e8-9869-131c928c237a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:37.338437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bfc59-d5a0-43e8-9869-131c928c237a service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:37.338728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bfc59-d5a0-43e8-9869-131c928c237a service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:37.339031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bfc59-d5a0-43e8-9869-131c928c237a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:37.357088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bfc59-d5a0-43e8-9869-131c928c237a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:37.361132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bfc59-d5a0-43e8-9869-131c928c237a service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:37.379085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 821/1640] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:39.064374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04122dd-2f2f-4efa-acdb-526cc51385db None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:39.066449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c04122dd-2f2f-4efa-acdb-526cc51385db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:39.090308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04122dd-2f2f-4efa-acdb-526cc51385db None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:39.102736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:39.103392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:39.103861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:39.104273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] PATH_INFO: `/v3/projects/a89a79515c564e37bfed75c840c89488` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:39.105637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a89a79515c564e37bfed75c840c89488)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:39.107719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:39.294249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a89a79515c564e37bfed75c840c89488', 'request_id': 'req-60ce118f-6679-47cc-8da5-195fa42f8402'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:39.301139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a89a79515c564e37bfed75c840c89488', 'request_id': 'req-60ce118f-6679-47cc-8da5-195fa42f8402'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:39.311395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a89a79515c564e37bfed75c840c89488', 'request_id': 'req-60ce118f-6679-47cc-8da5-195fa42f8402'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:39.428682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] The token cache is being invalidate because project a89a79515c564e37bfed75c840c89488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:22:39.429089 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:39.429888 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-60ce118f-6679-47cc-8da5-195fa42f8402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:39.432510 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 820/1641] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:22:39 2022] DELETE /identity/v3/projects/a89a79515c564e37bfed75c840c89488 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:39.436574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb723c4-2c68-4fcb-a07b-b18bc193131e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:39.437096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb723c4-2c68-4fcb-a07b-b18bc193131e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:39.437189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb723c4-2c68-4fcb-a07b-b18bc193131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:39.481135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bbb723c4-2c68-4fcb-a07b-b18bc193131e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:39.484848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bbb723c4-2c68-4fcb-a07b-b18bc193131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:39.525036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:39.598088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 822/1642] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:39.605829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14a5b-7c54-41d5-8504-2397763e1443 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:39.606301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14a5b-7c54-41d5-8504-2397763e1443 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:39.606734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14a5b-7c54-41d5-8504-2397763e1443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:39.633778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-43b14a5b-7c54-41d5-8504-2397763e1443 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:39.635261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-43b14a5b-7c54-41d5-8504-2397763e1443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:39.651271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 821/1643] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:39.655241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb723c4-2c68-4fcb-a07b-b18bc193131e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:39.669773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb723c4-2c68-4fcb-a07b-b18bc193131e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:39.682109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:39.684327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:39.685646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:39.686166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:39.687060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:39.691143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:39.692673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:39.726112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 823/1644] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:22:39.728566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b14a5b-7c54-41d5-8504-2397763e1443 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:39.747153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b14a5b-7c54-41d5-8504-2397763e1443 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:39.758483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61a49-c7da-402b-92ac-8afff44d270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:39.759649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61a49-c7da-402b-92ac-8afff44d270c admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:39.768257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61a49-c7da-402b-92ac-8afff44d270c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:39.768752 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61a49-c7da-402b-92ac-8afff44d270c admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:39.769472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d61a49-c7da-402b-92ac-8afff44d270c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:39.771684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d61a49-c7da-402b-92ac-8afff44d270c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:40.013209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 822/1645] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:39 2022] POST /identity/v3/projects => generated 357 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:40.017556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:40.035480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335230b-2919-44d6-95e0-41fe1ec0e46f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:40.147713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173bc3d-6c76-4cc9-afe6-9b30d3b4ddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:40.148097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173bc3d-6c76-4cc9-afe6-9b30d3b4ddb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:40.148403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173bc3d-6c76-4cc9-afe6-9b30d3b4ddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:40.148674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173bc3d-6c76-4cc9-afe6-9b30d3b4ddb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:40.160005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173bc3d-6c76-4cc9-afe6-9b30d3b4ddb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:40.166899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173bc3d-6c76-4cc9-afe6-9b30d3b4ddb0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:40.365831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 824/1646] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:40 2022] POST /identity/v3/users => generated 279 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:22:40.368589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61a49-c7da-402b-92ac-8afff44d270c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:40.400969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61a49-c7da-402b-92ac-8afff44d270c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:40.426946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f61917-f3a3-436d-ac65-898fe820b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:40.439694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f61917-f3a3-436d-ac65-898fe820b397 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:40.441061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f61917-f3a3-436d-ac65-898fe820b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:40.441061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f61917-f3a3-436d-ac65-898fe820b397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:40.441698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f61917-f3a3-436d-ac65-898fe820b397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:40.444011 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f61917-f3a3-436d-ac65-898fe820b397 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:40.451039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:40.462600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 823/1647] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:40.463539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173bc3d-6c76-4cc9-afe6-9b30d3b4ddb0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:40.494133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173bc3d-6c76-4cc9-afe6-9b30d3b4ddb0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:40.501012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e562-3a6f-4b72-a81c-40b0d4000493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:40.501899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e562-3a6f-4b72-a81c-40b0d4000493 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:40.502315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e562-3a6f-4b72-a81c-40b0d4000493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:40.502731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e562-3a6f-4b72-a81c-40b0d4000493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:40.503555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319e562-3a6f-4b72-a81c-40b0d4000493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:40.506152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319e562-3a6f-4b72-a81c-40b0d4000493 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:40.522234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 825/1648] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:22:40.526879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f61917-f3a3-436d-ac65-898fe820b397 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:40.548022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f61917-f3a3-436d-ac65-898fe820b397 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:40.569297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff589f4-5abe-4118-89e7-ab7db6bc85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:40.570063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff589f4-5abe-4118-89e7-ab7db6bc85c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:40.570953 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff589f4-5abe-4118-89e7-ab7db6bc85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:40.571905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff589f4-5abe-4118-89e7-ab7db6bc85c9 admin admin] PATH_INFO: `/v3/projects/2e19bc8ef290421d9e56f3a8331e4974/users/612742e1ffd949f7b79c1de27a510d90/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:40.597754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff589f4-5abe-4118-89e7-ab7db6bc85c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e19bc8ef290421d9e56f3a8331e4974, user_id=612742e1ffd949f7b79c1de27a510d90, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:40.601259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff589f4-5abe-4118-89e7-ab7db6bc85c9 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:40.713173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 824/1649] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:40 2022] PUT /identity/v3/projects/2e19bc8ef290421d9e56f3a8331e4974/users/612742e1ffd949f7b79c1de27a510d90/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:40.725134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1f5c-4c13-46cf-959e-7db103c7d1d3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:40.725481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1f5c-4c13-46cf-959e-7db103c7d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:40.725829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a1f5c-4c13-46cf-959e-7db103c7d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:40.804214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-910a1f5c-4c13-46cf-959e-7db103c7d1d3 None None] MFA Rules not processed for user `612742e1ffd949f7b79c1de27a510d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:40.814091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-910a1f5c-4c13-46cf-959e-7db103c7d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:41.001326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 826/1650] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:41.003502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff589f4-5abe-4118-89e7-ab7db6bc85c9 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:41.169165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff589f4-5abe-4118-89e7-ab7db6bc85c9 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:41.184836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5dc4c-5b4e-409e-951b-5680a44632f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:41.185747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5dc4c-5b4e-409e-951b-5680a44632f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:41.186032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5dc4c-5b4e-409e-951b-5680a44632f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:41.186315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5dc4c-5b4e-409e-951b-5680a44632f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:41.186961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5dc4c-5b4e-409e-951b-5680a44632f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:41.199926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5dc4c-5b4e-409e-951b-5680a44632f0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:41.392994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 825/1651] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:41 2022] POST /identity/v3/projects => generated 357 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:41.398368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a1f5c-4c13-46cf-959e-7db103c7d1d3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:41.443357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a1f5c-4c13-46cf-959e-7db103c7d1d3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:41.603311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39578-a8d1-4f75-abb0-d8aa326a445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:41.604078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39578-a8d1-4f75-abb0-d8aa326a445f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:41.604392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39578-a8d1-4f75-abb0-d8aa326a445f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:41.604719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39578-a8d1-4f75-abb0-d8aa326a445f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:41.605374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e39578-a8d1-4f75-abb0-d8aa326a445f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:41.607783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e39578-a8d1-4f75-abb0-d8aa326a445f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:41.731624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 827/1652] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:41 2022] POST /identity/v3/users => generated 285 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:41.735755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5dc4c-5b4e-409e-951b-5680a44632f0 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:41.769036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5dc4c-5b4e-409e-951b-5680a44632f0 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:41.784498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15669c-2eff-43ff-8929-7a33f6f2c8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:41.785139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15669c-2eff-43ff-8929-7a33f6f2c8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:41.785653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15669c-2eff-43ff-8929-7a33f6f2c8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:41.785934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15669c-2eff-43ff-8929-7a33f6f2c8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:41.786605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15669c-2eff-43ff-8929-7a33f6f2c8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:41.788249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15669c-2eff-43ff-8929-7a33f6f2c8d9 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:41.809348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:41.824327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 826/1653] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:41.826101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39578-a8d1-4f75-abb0-d8aa326a445f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:41.863468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39578-a8d1-4f75-abb0-d8aa326a445f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:41.865079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de371e-d97d-4f3c-b9be-4ab6f3e79496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:41.865845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de371e-d97d-4f3c-b9be-4ab6f3e79496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:41.866195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de371e-d97d-4f3c-b9be-4ab6f3e79496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:41.867038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de371e-d97d-4f3c-b9be-4ab6f3e79496 admin admin] PATH_INFO: `/v3/projects/2ade44ff6e7b419d8747a1feef81bbb3/users/952b83801bfb4ae782cc0b4cf2812f38/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:41.929424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de371e-d97d-4f3c-b9be-4ab6f3e79496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ade44ff6e7b419d8747a1feef81bbb3, user_id=952b83801bfb4ae782cc0b4cf2812f38, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:41.942126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de371e-d97d-4f3c-b9be-4ab6f3e79496 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:42.017553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 828/1654] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:41 2022] PUT /identity/v3/projects/2ade44ff6e7b419d8747a1feef81bbb3/users/952b83801bfb4ae782cc0b4cf2812f38/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:42.021644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15669c-2eff-43ff-8929-7a33f6f2c8d9 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:42.055280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15669c-2eff-43ff-8929-7a33f6f2c8d9 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:42.230887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1245d-b948-4b1f-b0fd-904b09fcb38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:42.230887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1245d-b948-4b1f-b0fd-904b09fcb38e admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:42.230887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1245d-b948-4b1f-b0fd-904b09fcb38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:42.230887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1245d-b948-4b1f-b0fd-904b09fcb38e admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:42.231323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1245d-b948-4b1f-b0fd-904b09fcb38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:42.231922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1245d-b948-4b1f-b0fd-904b09fcb38e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:42.264353 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 827/1655] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:42.268150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de371e-d97d-4f3c-b9be-4ab6f3e79496 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:42.286025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de371e-d97d-4f3c-b9be-4ab6f3e79496 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:42.299396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:42.300423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:42.300854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:42.301985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] PATH_INFO: `/v3/projects/2ade44ff6e7b419d8747a1feef81bbb3/users/952b83801bfb4ae782cc0b4cf2812f38/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:42.306730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ade44ff6e7b419d8747a1feef81bbb3, user_id=952b83801bfb4ae782cc0b4cf2812f38, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:42.313402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:42.339389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 829/1656] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:42 2022] PUT /identity/v3/projects/2ade44ff6e7b419d8747a1feef81bbb3/users/952b83801bfb4ae782cc0b4cf2812f38/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:42.351421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568070-78bd-4971-a66f-0246626f5a94 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:42.351727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568070-78bd-4971-a66f-0246626f5a94 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:42.352091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568070-78bd-4971-a66f-0246626f5a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:42.446204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a0568070-78bd-4971-a66f-0246626f5a94 None None] MFA Rules not processed for user `952b83801bfb4ae782cc0b4cf2812f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:42.448327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a0568070-78bd-4971-a66f-0246626f5a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:42.564344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:42.665841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 828/1657] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:42.678880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:42.682036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:42.778862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f8d1-9199-457c-802f-63b28036161b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:42.783491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:42.784555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:42.785108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:42.785588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:42.800002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:42.818988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:42.851538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 830/1658] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:43.223258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0568070-78bd-4971-a66f-0246626f5a94 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:43.224744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a0568070-78bd-4971-a66f-0246626f5a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:43.249581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0568070-78bd-4971-a66f-0246626f5a94 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:43.261289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068d819-c680-42ed-9723-ff01203307b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:43.261931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d819-c680-42ed-9723-ff01203307b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:43.262217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d819-c680-42ed-9723-ff01203307b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:43.262496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d819-c680-42ed-9723-ff01203307b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:43.422904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068d819-c680-42ed-9723-ff01203307b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:43.424840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068d819-c680-42ed-9723-ff01203307b0 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:43.438010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 829/1659] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:43.686822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:43.687986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:43.905618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e7415-e42f-4833-ac64-ef541f295d06 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:43.928283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:43.928998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:43.929280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:43.929553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] PATH_INFO: `/v3/users/79b7f521de1b418ca206d1948e00a748` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:43.931685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b7f521de1b418ca206d1948e00a748)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:43.939532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:43.981938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:44.230433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b7f521de1b418ca206d1948e00a748'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:44.232676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b7f521de1b418ca206d1948e00a748'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:44.375136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b7f521de1b418ca206d1948e00a748'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:44.388101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b7f521de1b418ca206d1948e00a748'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:44.425662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b7f521de1b418ca206d1948e00a748'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:44.435771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 831/1660] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:22:43 2022] DELETE /identity/v3/users/79b7f521de1b418ca206d1948e00a748 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:44.441392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664853c-5a04-48b6-9b9d-85c290431803 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:44.442467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664853c-5a04-48b6-9b9d-85c290431803 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:44.442945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664853c-5a04-48b6-9b9d-85c290431803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:44.507352 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-9664853c-5a04-48b6-9b9d-85c290431803 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:44.511454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9664853c-5a04-48b6-9b9d-85c290431803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:44.651663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 830/1661] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:22:44.828871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:44.831368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:45.020399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b2a0-2794-4598-b615-6762e317b4e7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:45.029425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:45.031725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:45.032017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:45.032401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:45.078900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:45.085490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:45.120222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 832/1662] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:46.354097 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2358-082f-408c-8b18-033fa900fb22 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:46.354989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2358-082f-408c-8b18-033fa900fb22 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:46.355424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2358-082f-408c-8b18-033fa900fb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:46.422734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-6fbc2358-082f-408c-8b18-033fa900fb22 None None] MFA Rules not processed for user `9713207bf34847ae8faf498fc96061e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:46.424029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6fbc2358-082f-408c-8b18-033fa900fb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:46.565608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:46.571696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 831/1663] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:46.586799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:46.590622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:46.645543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2358-082f-408c-8b18-033fa900fb22 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:46.648134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6fbc2358-082f-408c-8b18-033fa900fb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:46.699456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2358-082f-408c-8b18-033fa900fb22 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:46.715259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:46.717210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:46.718239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:46.718519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] PATH_INFO: `/v3/projects/309ab1da3426405fa8bf76ff81a2b459` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:46.721393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309ab1da3426405fa8bf76ff81a2b459)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:46.723549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:46.772868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd726161-fa2b-4443-988b-ce4a34467ee5 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:46.781322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876180f6-4dac-422a-ac28-9e7f2ca66b17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:46.782322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876180f6-4dac-422a-ac28-9e7f2ca66b17 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:46.782742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876180f6-4dac-422a-ac28-9e7f2ca66b17 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:46.783246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876180f6-4dac-422a-ac28-9e7f2ca66b17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:46.800113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876180f6-4dac-422a-ac28-9e7f2ca66b17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:46.805220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876180f6-4dac-422a-ac28-9e7f2ca66b17 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:46.852805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 833/1664] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:46.912082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309ab1da3426405fa8bf76ff81a2b459', 'request_id': 'req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:46.931818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309ab1da3426405fa8bf76ff81a2b459', 'request_id': 'req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:46.957918 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309ab1da3426405fa8bf76ff81a2b459', 'request_id': 'req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:47.055377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] The token cache is being invalidate because project 309ab1da3426405fa8bf76ff81a2b459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:22:47.055685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:47.056686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c247b3ed-ef58-44cd-ab6b-572e3f7f0023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:47.059170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 832/1665] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:22:46 2022] DELETE /identity/v3/projects/309ab1da3426405fa8bf76ff81a2b459 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:47.068777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1664cda-df1d-4448-bb7f-1173b07fe259 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:47.069216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1664cda-df1d-4448-bb7f-1173b07fe259 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:47.071316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1664cda-df1d-4448-bb7f-1173b07fe259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:47.115418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d1664cda-df1d-4448-bb7f-1173b07fe259 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:47.116737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d1664cda-df1d-4448-bb7f-1173b07fe259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:47.160436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:47.225871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 834/1666] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:47.248608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6929-f8ba-4e59-b289-94a1cd73276b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:47.248894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6929-f8ba-4e59-b289-94a1cd73276b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:47.249763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6929-f8ba-4e59-b289-94a1cd73276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:47.318881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ca2c6929-f8ba-4e59-b289-94a1cd73276b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:47.320131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ca2c6929-f8ba-4e59-b289-94a1cd73276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:47.349582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 833/1667] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:47.350361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1664cda-df1d-4448-bb7f-1173b07fe259 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:47.376717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1664cda-df1d-4448-bb7f-1173b07fe259 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:47.403401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:47.404036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:47.407256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:47.407256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:47.407256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:47.407256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:47.411377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:47.444874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 835/1668] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:22:47.450730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c6929-f8ba-4e59-b289-94a1cd73276b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:47.478847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c6929-f8ba-4e59-b289-94a1cd73276b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:47.523777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb56e1-b428-43bb-907c-99a5e180ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:47.524530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb56e1-b428-43bb-907c-99a5e180ee5d admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:47.524806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb56e1-b428-43bb-907c-99a5e180ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:47.525117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb56e1-b428-43bb-907c-99a5e180ee5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:47.525717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb56e1-b428-43bb-907c-99a5e180ee5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:47.527658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb56e1-b428-43bb-907c-99a5e180ee5d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:47.701213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 834/1669] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:47 2022] POST /identity/v3/projects => generated 371 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:47.705437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:47.721789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6afc-c65b-4e3e-8668-fa0a228c9912 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:47.859677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c3020-41ca-4ffc-93ca-acd4961b53e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:47.861417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c3020-41ca-4ffc-93ca-acd4961b53e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:47.861417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c3020-41ca-4ffc-93ca-acd4961b53e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:47.861658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c3020-41ca-4ffc-93ca-acd4961b53e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:47.862319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c3020-41ca-4ffc-93ca-acd4961b53e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:47.868941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c3020-41ca-4ffc-93ca-acd4961b53e2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:48.009231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 836/1670] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:47 2022] POST /identity/v3/users => generated 286 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:48.011558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb56e1-b428-43bb-907c-99a5e180ee5d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:48.037093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb56e1-b428-43bb-907c-99a5e180ee5d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:48.048641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059c929-767e-40c7-a56e-bb800eb26593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:48.049529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c929-767e-40c7-a56e-bb800eb26593 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:48.049912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c929-767e-40c7-a56e-bb800eb26593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:48.050283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c929-767e-40c7-a56e-bb800eb26593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:48.051192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059c929-767e-40c7-a56e-bb800eb26593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:48.053644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059c929-767e-40c7-a56e-bb800eb26593 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:48.081587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 835/1671] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:48.082969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c3020-41ca-4ffc-93ca-acd4961b53e2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:48.099230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c3020-41ca-4ffc-93ca-acd4961b53e2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:48.120000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81835d-cf0d-493f-9925-5f787f34720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:48.120894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81835d-cf0d-493f-9925-5f787f34720f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:48.121352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81835d-cf0d-493f-9925-5f787f34720f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:48.121628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81835d-cf0d-493f-9925-5f787f34720f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:48.122294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81835d-cf0d-493f-9925-5f787f34720f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:48.123907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81835d-cf0d-493f-9925-5f787f34720f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:48.147782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 837/1672] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:48.153065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059c929-767e-40c7-a56e-bb800eb26593 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:48.179546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059c929-767e-40c7-a56e-bb800eb26593 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:48.225974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de87f-310c-4a24-897d-93f5e9e76d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:48.228584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de87f-310c-4a24-897d-93f5e9e76d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:48.232754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de87f-310c-4a24-897d-93f5e9e76d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:48.237240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de87f-310c-4a24-897d-93f5e9e76d47 admin admin] PATH_INFO: `/v3/projects/5251cf0d834540ceafaf7c720fc28170/users/cd2a9360ebe4403aa5ed2e543b7a2096/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:48.268365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557de87f-310c-4a24-897d-93f5e9e76d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5251cf0d834540ceafaf7c720fc28170, user_id=cd2a9360ebe4403aa5ed2e543b7a2096, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:48.290949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557de87f-310c-4a24-897d-93f5e9e76d47 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:48.413251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 836/1673] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:48 2022] PUT /identity/v3/projects/5251cf0d834540ceafaf7c720fc28170/users/cd2a9360ebe4403aa5ed2e543b7a2096/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:48.414934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce898a4-ec46-443e-90b6-719eeae2d863 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:48.415295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce898a4-ec46-443e-90b6-719eeae2d863 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:48.415584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce898a4-ec46-443e-90b6-719eeae2d863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:48.497077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cce898a4-ec46-443e-90b6-719eeae2d863 None None] MFA Rules not processed for user `cd2a9360ebe4403aa5ed2e543b7a2096`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:48.502557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cce898a4-ec46-443e-90b6-719eeae2d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:48.724723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 838/1674] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:48.728794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de87f-310c-4a24-897d-93f5e9e76d47 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:48.891062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de87f-310c-4a24-897d-93f5e9e76d47 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:48.900194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61a8d4-b6e3-4d47-bfc7-60305601d873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:48.906115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a8d4-b6e3-4d47-bfc7-60305601d873 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:48.906115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a8d4-b6e3-4d47-bfc7-60305601d873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:48.906115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a8d4-b6e3-4d47-bfc7-60305601d873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:48.906115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61a8d4-b6e3-4d47-bfc7-60305601d873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:48.906115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61a8d4-b6e3-4d47-bfc7-60305601d873 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:48.946660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce898a4-ec46-443e-90b6-719eeae2d863 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:48.948865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cce898a4-ec46-443e-90b6-719eeae2d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:48.981999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce898a4-ec46-443e-90b6-719eeae2d863 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:49.003477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:49.007557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:49.007557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:49.007557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] PATH_INFO: `/v3/users/f5dde9abd0df458f80b764500c0939c3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:49.007557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5dde9abd0df458f80b764500c0939c3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:49.008011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:49.068458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 837/1675] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:48 2022] POST /identity/v3/projects => generated 373 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:49.074392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61a8d4-b6e3-4d47-bfc7-60305601d873 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:49.106160 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:49.221814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61a8d4-b6e3-4d47-bfc7-60305601d873 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:49.234238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:49.234880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:49.235160 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:49.235485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:49.236178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:49.238424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:49.267790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5dde9abd0df458f80b764500c0939c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:49.268735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5dde9abd0df458f80b764500c0939c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:49.354421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 838/1676] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:49 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:49.358720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:49.360906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:49.385514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5dde9abd0df458f80b764500c0939c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:49.385932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdceaf-8fae-44d6-b85a-11b6832c4df4 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:49.392852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7534f87-ef41-4f1c-920a-2b797853e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:49.394506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7534f87-ef41-4f1c-920a-2b797853e64c admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:49.395238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7534f87-ef41-4f1c-920a-2b797853e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:49.395796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7534f87-ef41-4f1c-920a-2b797853e64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:49.396280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5dde9abd0df458f80b764500c0939c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:49.399963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7534f87-ef41-4f1c-920a-2b797853e64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:49.402551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7534f87-ef41-4f1c-920a-2b797853e64c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:49.437334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5dde9abd0df458f80b764500c0939c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:49.449018 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 839/1677] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:49.454938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665304c6-7197-42e2-bf9d-8314f346383d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:49.454938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665304c6-7197-42e2-bf9d-8314f346383d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:49.455171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665304c6-7197-42e2-bf9d-8314f346383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:49.458721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 839/1678] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:22:48 2022] DELETE /identity/v3/users/f5dde9abd0df458f80b764500c0939c3 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:22:49.475289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:49.561670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-665304c6-7197-42e2-bf9d-8314f346383d None None] MFA Rules not processed for user `d1bd70f21aed4b2bae45199a5901c00b`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:49.564356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-665304c6-7197-42e2-bf9d-8314f346383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:49.643569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d5026-4c11-40a7-b873-16257580ffe6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:49.657932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7d0b8-c1e7-4176-89e9-189dc24a310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:49.659016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7d0b8-c1e7-4176-89e9-189dc24a310b admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:49.661739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7d0b8-c1e7-4176-89e9-189dc24a310b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:49.661739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7d0b8-c1e7-4176-89e9-189dc24a310b admin admin] PATH_INFO: `/v3/projects/290bc4e740ef40f08d623ddc0def56f4/users/e405c2ab01b246bfbfdb2ac23378dc2d/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:49.706554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7d0b8-c1e7-4176-89e9-189dc24a310b admin admin] RBAC: Authorizing `identity:create_grant(project_id=290bc4e740ef40f08d623ddc0def56f4, user_id=e405c2ab01b246bfbfdb2ac23378dc2d, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:49.709908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7d0b8-c1e7-4176-89e9-189dc24a310b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:49.738023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 840/1679] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:49.740098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13763e-a7d9-4f6f-a1a2-ebef7e093238 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:49.740690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13763e-a7d9-4f6f-a1a2-ebef7e093238 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:49.741126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13763e-a7d9-4f6f-a1a2-ebef7e093238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:49.778326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5e13763e-a7d9-4f6f-a1a2-ebef7e093238 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:49.779570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5e13763e-a7d9-4f6f-a1a2-ebef7e093238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:49.792377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 841/1680] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:49.793455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13763e-a7d9-4f6f-a1a2-ebef7e093238 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:49.794937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5e13763e-a7d9-4f6f-a1a2-ebef7e093238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:49.804071 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 840/1681] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:49 2022] PUT /identity/v3/projects/290bc4e740ef40f08d623ddc0def56f4/users/e405c2ab01b246bfbfdb2ac23378dc2d/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:49.809526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7d0b8-c1e7-4176-89e9-189dc24a310b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:49.834103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:50.026903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7d0b8-c1e7-4176-89e9-189dc24a310b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:50.061901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:50.069888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:50.070150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13763e-a7d9-4f6f-a1a2-ebef7e093238 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:50.070634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:50.074245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:50.085054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:50.090943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:50.138703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 841/1682] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:22:50.142165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:50.150763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:50.347216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd741-343c-4971-bb58-4db68ab8c9fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:50.348730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd741-343c-4971-bb58-4db68ab8c9fa service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:50.348730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd741-343c-4971-bb58-4db68ab8c9fa service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:50.348730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd741-343c-4971-bb58-4db68ab8c9fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:50.403818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6da80-b95e-4dce-819d-47695eda467d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:50.413932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5484-d594-4f6d-a154-5d292d37db50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:50.415619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5484-d594-4f6d-a154-5d292d37db50 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:50.415920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5484-d594-4f6d-a154-5d292d37db50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:50.416169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5484-d594-4f6d-a154-5d292d37db50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:50.443771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f5484-d594-4f6d-a154-5d292d37db50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:50.446514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f5484-d594-4f6d-a154-5d292d37db50 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:50.478996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 842/1683] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:50.486368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844e52-b663-4b00-9086-3cf56220bd12 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:50.486696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844e52-b663-4b00-9086-3cf56220bd12 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:50.486882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844e52-b663-4b00-9086-3cf56220bd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:50.527023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dd741-343c-4971-bb58-4db68ab8c9fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:50.535101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dd741-343c-4971-bb58-4db68ab8c9fa service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:50.570058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 842/1684] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:50.570745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd741-343c-4971-bb58-4db68ab8c9fa service nova] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:50.590457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a6844e52-b663-4b00-9086-3cf56220bd12 None None] MFA Rules not processed for user `732e7072abde49de887256b43707c0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:50.594876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a6844e52-b663-4b00-9086-3cf56220bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:50.601622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd741-343c-4971-bb58-4db68ab8c9fa service nova] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:50.618231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b43cf4-8243-4032-b332-7e8d294174ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:50.618967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b43cf4-8243-4032-b332-7e8d294174ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:50.619256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b43cf4-8243-4032-b332-7e8d294174ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:50.619534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b43cf4-8243-4032-b332-7e8d294174ca admin admin] PATH_INFO: `/v3/projects/290bc4e740ef40f08d623ddc0def56f4/users/e405c2ab01b246bfbfdb2ac23378dc2d/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:50.626826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b43cf4-8243-4032-b332-7e8d294174ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=290bc4e740ef40f08d623ddc0def56f4, user_id=e405c2ab01b246bfbfdb2ac23378dc2d, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:50.631500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b43cf4-8243-4032-b332-7e8d294174ca admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:50.660207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 843/1685] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:50 2022] PUT /identity/v3/projects/290bc4e740ef40f08d623ddc0def56f4/users/e405c2ab01b246bfbfdb2ac23378dc2d/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:50.676655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed57af-8e0b-4cd9-9a20-7e1341fd3dbf None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:50.676655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed57af-8e0b-4cd9-9a20-7e1341fd3dbf None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:50.676655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed57af-8e0b-4cd9-9a20-7e1341fd3dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:50.784547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-30ed57af-8e0b-4cd9-9a20-7e1341fd3dbf None None] MFA Rules not processed for user `e405c2ab01b246bfbfdb2ac23378dc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:50.787008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-30ed57af-8e0b-4cd9-9a20-7e1341fd3dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:50.794862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 843/1686] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:50.802665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6844e52-b663-4b00-9086-3cf56220bd12 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:50.809001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a6844e52-b663-4b00-9086-3cf56220bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:50.868339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6844e52-b663-4b00-9086-3cf56220bd12 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:51.130060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 844/1687] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:22:51.130060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed57af-8e0b-4cd9-9a20-7e1341fd3dbf None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:51.133381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-30ed57af-8e0b-4cd9-9a20-7e1341fd3dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:51.180494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:51.181840 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:51.182120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:51.182393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:51.336239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed57af-8e0b-4cd9-9a20-7e1341fd3dbf None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:51.341481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be08bb2-bfdf-4994-a4f7-c8745ac157d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:51.344288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08bb2-bfdf-4994-a4f7-c8745ac157d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:51.344288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08bb2-bfdf-4994-a4f7-c8745ac157d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:51.376694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be08bb2-bfdf-4994-a4f7-c8745ac157d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:51.398789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be08bb2-bfdf-4994-a4f7-c8745ac157d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:51.402613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be08bb2-bfdf-4994-a4f7-c8745ac157d2 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:51.409642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:51.411324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:51.441112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 845/1688] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:51.446975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 844/1689] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:22:51.884780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:52.211244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89af0-c17f-4a1d-bc6d-1d2ac1c0ea78 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:52.212672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89af0-c17f-4a1d-bc6d-1d2ac1c0ea78 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:52.214188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89af0-c17f-4a1d-bc6d-1d2ac1c0ea78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:52.234165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:52.235995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:52.323780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:52.334217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c7b89af0-c17f-4a1d-bc6d-1d2ac1c0ea78 None None] MFA Rules not processed for user `8bdb4c1d97ec4212ab56e8be7ff879ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:52.336343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c7b89af0-c17f-4a1d-bc6d-1d2ac1c0ea78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:52.359679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53502745-0215-42bf-9ea0-e1419f7d3544 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:52.367190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:52.368454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:52.368894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:52.369498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] PATH_INFO: `/v3/projects/8405cb3e2f8544d59641c3747ccab03d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:52.370854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8405cb3e2f8544d59641c3747ccab03d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:52.372277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:22:52.372277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: warnings.warn(msg) Aug 10 11:22:52.372277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: Aug 10 11:22:52.374879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:52.506865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 846/1690] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:52.518456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294267bd-f7bf-4ab0-9be5-801058b24b99 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:52.518767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294267bd-f7bf-4ab0-9be5-801058b24b99 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:52.519050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294267bd-f7bf-4ab0-9be5-801058b24b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:52.584618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-294267bd-f7bf-4ab0-9be5-801058b24b99 None None] MFA Rules not processed for user `8bdb4c1d97ec4212ab56e8be7ff879ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:52.584618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-294267bd-f7bf-4ab0-9be5-801058b24b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:52.600925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8405cb3e2f8544d59641c3747ccab03d', 'request_id': 'req-44325122-e796-44eb-ae2a-4bbb53884aa2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:52.614284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8405cb3e2f8544d59641c3747ccab03d', 'request_id': 'req-44325122-e796-44eb-ae2a-4bbb53884aa2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:52.648860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8405cb3e2f8544d59641c3747ccab03d', 'request_id': 'req-44325122-e796-44eb-ae2a-4bbb53884aa2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:52.671232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 847/1691] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:52.676440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a8a49-65d1-468d-9405-3e7d4eab6b93 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:52.676440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a8a49-65d1-468d-9405-3e7d4eab6b93 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:52.676440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a8a49-65d1-468d-9405-3e7d4eab6b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:52.700037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a75a8a49-65d1-468d-9405-3e7d4eab6b93 None None] MFA Rules not processed for user `9713207bf34847ae8faf498fc96061e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:52.701602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a75a8a49-65d1-468d-9405-3e7d4eab6b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:52.770934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] The token cache is being invalidate because project 8405cb3e2f8544d59641c3747ccab03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:22:52.771589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:52.774245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:52.794557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 845/1692] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:22:52 2022] DELETE /identity/v3/projects/8405cb3e2f8544d59641c3747ccab03d => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:22:52.795507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:52.804673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:52.827098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 848/1693] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:52.837442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238042-33a7-4684-9d82-85c69454fc9e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:52.837442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238042-33a7-4684-9d82-85c69454fc9e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:52.837442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238042-33a7-4684-9d82-85c69454fc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:52.867261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-0a238042-33a7-4684-9d82-85c69454fc9e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:52.869045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0a238042-33a7-4684-9d82-85c69454fc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:52.934032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44325122-e796-44eb-ae2a-4bbb53884aa2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:52.940994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18431078-da37-4880-8b88-9897db10e019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:52.950597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18431078-da37-4880-8b88-9897db10e019 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:52.950597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18431078-da37-4880-8b88-9897db10e019 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:52.950597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18431078-da37-4880-8b88-9897db10e019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:52.950597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-18431078-da37-4880-8b88-9897db10e019 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:52.956897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18431078-da37-4880-8b88-9897db10e019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:52.958554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18431078-da37-4880-8b88-9897db10e019 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:52.965569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 849/1694] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:52.974567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e6c2-4eda-471b-a345-0cf147b3e58d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:52.979483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e6c2-4eda-471b-a345-0cf147b3e58d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:52.979483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62e6c2-4eda-471b-a345-0cf147b3e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:52.979673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 846/1695] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:53.032401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8b62e6c2-4eda-471b-a345-0cf147b3e58d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:53.036769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8b62e6c2-4eda-471b-a345-0cf147b3e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:53.062158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 850/1696] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:53.068804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18431078-da37-4880-8b88-9897db10e019 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:53.085919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18431078-da37-4880-8b88-9897db10e019 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:53.098950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:53.100176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.102280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.102864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:53.103727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:53.105311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:53.107135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:53.141413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 847/1697] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:53.145254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62e6c2-4eda-471b-a345-0cf147b3e58d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:53.158524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62e6c2-4eda-471b-a345-0cf147b3e58d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:53.170996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:53.175155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:53.181037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ef40-335b-4fc2-a8c9-5b72f34d2b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:53.181657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ef40-335b-4fc2-a8c9-5b72f34d2b3a admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.181937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ef40-335b-4fc2-a8c9-5b72f34d2b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.182210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ef40-335b-4fc2-a8c9-5b72f34d2b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:53.185947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ef40-335b-4fc2-a8c9-5b72f34d2b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:53.194247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ef40-335b-4fc2-a8c9-5b72f34d2b3a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:53.203874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acf1ef-5409-4081-8457-e12d845da5dd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:53.216657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:53.217415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.219270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.219270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] PATH_INFO: `/v3/users/cd2a9360ebe4403aa5ed2e543b7a2096` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:53.219475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2a9360ebe4403aa5ed2e543b7a2096)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:53.221495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:53.322452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 851/1698] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:53 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:22:53.326315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ef40-335b-4fc2-a8c9-5b72f34d2b3a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:53.462885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ef40-335b-4fc2-a8c9-5b72f34d2b3a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:53.470162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:53.471261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.471811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.472338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:53.473290 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:53.475311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2a9360ebe4403aa5ed2e543b7a2096'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:53.480647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2a9360ebe4403aa5ed2e543b7a2096'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:53.488570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:53.571093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2a9360ebe4403aa5ed2e543b7a2096'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:53.582985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2a9360ebe4403aa5ed2e543b7a2096'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:53.598317 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 852/1699] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:53 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:22:53.605176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:53.613150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:53.615171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f6b15661-a953-4752-8aa8-0c036acb52db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2a9360ebe4403aa5ed2e543b7a2096'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:53.638148 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 848/1700] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:22:53 2022] DELETE /identity/v3/users/cd2a9360ebe4403aa5ed2e543b7a2096 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:53.649519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f64a42-5609-4549-9625-3d65ef2e503c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.649812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f64a42-5609-4549-9625-3d65ef2e503c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.650108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f64a42-5609-4549-9625-3d65ef2e503c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:53.651300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d736d-5265-42d8-a69a-0b50abd176ac admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:53.685524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a3f64a42-5609-4549-9625-3d65ef2e503c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:53.687975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a3f64a42-5609-4549-9625-3d65ef2e503c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:53.715337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:53.795118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:53.798860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.799143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.799571 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:53.800246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:53.804569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:53.840433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 849/1701] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:53.859763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 853/1702] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:53.861471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f64a42-5609-4549-9625-3d65ef2e503c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:53.888733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f64a42-5609-4549-9625-3d65ef2e503c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:53.893712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:53.898821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:53.904881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f52fa8-032a-4f26-aa4d-c272db71edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:53.905667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f52fa8-032a-4f26-aa4d-c272db71edb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.905914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f52fa8-032a-4f26-aa4d-c272db71edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.906202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f52fa8-032a-4f26-aa4d-c272db71edb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:53.906844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f52fa8-032a-4f26-aa4d-c272db71edb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:53.914750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f52fa8-032a-4f26-aa4d-c272db71edb6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:53.945627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 850/1703] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:53.946957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d34bc4-a37d-4601-8885-4d3e6a927f3b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.947241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d34bc4-a37d-4601-8885-4d3e6a927f3b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.947512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d34bc4-a37d-4601-8885-4d3e6a927f3b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:53.948911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 851/1704] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 10 11:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:22:53.949454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d34bc4-a37d-4601-8885-4d3e6a927f3b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:53.991006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d34bc4-a37d-4601-8885-4d3e6a927f3b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:53.995883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf17ff-be20-4b18-94aa-0f99b2f8db01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:53.996632 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf17ff-be20-4b18-94aa-0f99b2f8db01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:53.996923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf17ff-be20-4b18-94aa-0f99b2f8db01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:53.997199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf17ff-be20-4b18-94aa-0f99b2f8db01 admin admin] PATH_INFO: `/v3/projects/d2f0f3b467cc487ca1abf8a6b84a3560/users/eacc294b7f4e40ebb8f9f98b5f2e097e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.028925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf17ff-be20-4b18-94aa-0f99b2f8db01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f0f3b467cc487ca1abf8a6b84a3560, user_id=eacc294b7f4e40ebb8f9f98b5f2e097e, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:54.032426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf17ff-be20-4b18-94aa-0f99b2f8db01 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:54.057490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163a8fa-ffcc-4002-b224-32e685a17514 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:54.069797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298172f-8dfb-45bd-ab31-70838d1a8642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:54.070697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298172f-8dfb-45bd-ab31-70838d1a8642 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.071201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298172f-8dfb-45bd-ab31-70838d1a8642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.071700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298172f-8dfb-45bd-ab31-70838d1a8642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.103905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298172f-8dfb-45bd-ab31-70838d1a8642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:54.105675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298172f-8dfb-45bd-ab31-70838d1a8642 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:54.136518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 852/1706] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:53 2022] PUT /identity/v3/projects/d2f0f3b467cc487ca1abf8a6b84a3560/users/eacc294b7f4e40ebb8f9f98b5f2e097e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:54.149068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00223166-806e-4903-8c25-4e4116353450 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.149068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00223166-806e-4903-8c25-4e4116353450 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.149068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00223166-806e-4903-8c25-4e4116353450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.149726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 854/1706] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:54.152138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c916f9-dfc2-4f2d-82b6-aa681c57ec09 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.152453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c916f9-dfc2-4f2d-82b6-aa681c57ec09 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.152728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c916f9-dfc2-4f2d-82b6-aa681c57ec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.258636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d4c916f9-dfc2-4f2d-82b6-aa681c57ec09 None None] MFA Rules not processed for user `eacc294b7f4e40ebb8f9f98b5f2e097e`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:54.260023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:54.266264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d4c916f9-dfc2-4f2d-82b6-aa681c57ec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:54.301502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-00223166-806e-4903-8c25-4e4116353450 None None] MFA Rules not processed for user `512aab5a19c94651bfa0f634244dbdab`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:54.304243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-00223166-806e-4903-8c25-4e4116353450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:54.446727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 855/1707] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:22:54.447959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b19981-b610-4466-ae37-a243dfe89c72 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.448231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b19981-b610-4466-ae37-a243dfe89c72 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.448524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b19981-b610-4466-ae37-a243dfe89c72 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.450201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 856/1708] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 10 11:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:22:54.450909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b19981-b610-4466-ae37-a243dfe89c72 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:54.455607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 853/1709] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:54.457288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658fa-7fbb-4467-8b83-15848ac746ce None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.457819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658fa-7fbb-4467-8b83-15848ac746ce None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.458311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658fa-7fbb-4467-8b83-15848ac746ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.504101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-187658fa-7fbb-4467-8b83-15848ac746ce None None] MFA Rules not processed for user `512aab5a19c94651bfa0f634244dbdab`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:54.505991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-187658fa-7fbb-4467-8b83-15848ac746ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:54.531772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 854/1710] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:54.543396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187658fa-7fbb-4467-8b83-15848ac746ce None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:54.548477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187658fa-7fbb-4467-8b83-15848ac746ce None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:54.563181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:54.563946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.564343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.564731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.583375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:54.584947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b19981-b610-4466-ae37-a243dfe89c72 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:54.585133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:54.591038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:54.591751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.592140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.592528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.593396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:54.595472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:54.598850 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 855/1711] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:54.621369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:54.622822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:54.635028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd24d1-3369-440a-b03e-b71dc7eb69da service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:54.640563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d0485-05e1-48d0-8538-8242254b8ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:54.641362 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d0485-05e1-48d0-8538-8242254b8ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.641866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d0485-05e1-48d0-8538-8242254b8ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.642304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d0485-05e1-48d0-8538-8242254b8ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.652735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d0485-05e1-48d0-8538-8242254b8ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:54.657737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d0485-05e1-48d0-8538-8242254b8ae4 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:54.680963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 856/1712] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:54.737609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 857/1713] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:54 2022] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:54.741948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d0485-05e1-48d0-8538-8242254b8ae4 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:54.752906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:54.762830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d0485-05e1-48d0-8538-8242254b8ae4 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:54.932585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c08bd-d207-4b1c-bf29-444cff54a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:54.933236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c08bd-d207-4b1c-bf29-444cff54a5df admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:54.933518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c08bd-d207-4b1c-bf29-444cff54a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:54.933794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c08bd-d207-4b1c-bf29-444cff54a5df admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:54.934452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c08bd-d207-4b1c-bf29-444cff54a5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:54.937116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c08bd-d207-4b1c-bf29-444cff54a5df admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:54.974553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:54.981626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:54.984504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:55.001045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5b8c3-351e-44da-b9bf-5ceeb74b25df admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:55.020398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:55.021138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.021486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.021961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] PATH_INFO: `/v3/projects/5251cf0d834540ceafaf7c720fc28170` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.023815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5251cf0d834540ceafaf7c720fc28170)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:55.025642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:55.078105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 857/1714] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:54 2022] POST /identity/v3/users => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:55.082864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c08bd-d207-4b1c-bf29-444cff54a5df admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:55.109726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c08bd-d207-4b1c-bf29-444cff54a5df admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:55.117086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d9adc-4c97-4c0f-9bd4-986bc42bf20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:55.118100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d9adc-4c97-4c0f-9bd4-986bc42bf20c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.124951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d9adc-4c97-4c0f-9bd4-986bc42bf20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.124951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d9adc-4c97-4c0f-9bd4-986bc42bf20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.124951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d9adc-4c97-4c0f-9bd4-986bc42bf20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:55.124951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d9adc-4c97-4c0f-9bd4-986bc42bf20c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:55.140793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 858/1715] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:22:55.142221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d9adc-4c97-4c0f-9bd4-986bc42bf20c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:55.160054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d9adc-4c97-4c0f-9bd4-986bc42bf20c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:55.181393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a84f-4fcc-42eb-81e2-9f5837a625e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:55.182075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a84f-4fcc-42eb-81e2-9f5837a625e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.182358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a84f-4fcc-42eb-81e2-9f5837a625e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.187864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a84f-4fcc-42eb-81e2-9f5837a625e7 admin admin] PATH_INFO: `/v3/projects/a28d164c8bd54fea866ed7d5695d14c6/users/d831bd44f0aa46d791751593a9f8af94/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.207865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44a84f-4fcc-42eb-81e2-9f5837a625e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28d164c8bd54fea866ed7d5695d14c6, user_id=d831bd44f0aa46d791751593a9f8af94, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:55.210648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44a84f-4fcc-42eb-81e2-9f5837a625e7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:55.237953 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5251cf0d834540ceafaf7c720fc28170', 'request_id': 'req-b131e98f-362f-4c0e-8d60-990d6e88c4a0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.271858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5251cf0d834540ceafaf7c720fc28170', 'request_id': 'req-b131e98f-362f-4c0e-8d60-990d6e88c4a0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.288941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5251cf0d834540ceafaf7c720fc28170', 'request_id': 'req-b131e98f-362f-4c0e-8d60-990d6e88c4a0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.341198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 859/1716] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:55 2022] PUT /identity/v3/projects/a28d164c8bd54fea866ed7d5695d14c6/users/d831bd44f0aa46d791751593a9f8af94/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:22:55.348858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a84f-4fcc-42eb-81e2-9f5837a625e7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:55.391090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] The token cache is being invalidate because project 5251cf0d834540ceafaf7c720fc28170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:22:55.391090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.391090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.391090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 858/1717] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:22:54 2022] DELETE /identity/v3/projects/5251cf0d834540ceafaf7c720fc28170 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:55.394568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:55.396026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:55.562723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131e98f-362f-4c0e-8d60-990d6e88c4a0 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:55.569954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:55.571530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.571957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.572403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] PATH_INFO: `/v3/users/e405c2ab01b246bfbfdb2ac23378dc2d` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.574128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e405c2ab01b246bfbfdb2ac23378dc2d)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:55.575284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: WARNING py.warnings [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:22:55.575284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: warnings.warn(msg) Aug 10 11:22:55.575284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: Aug 10 11:22:55.579098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:55.599765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a84f-4fcc-42eb-81e2-9f5837a625e7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:55.614538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba96e0b-84e8-467f-bee4-d2b9ee28b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:55.620041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96e0b-84e8-467f-bee4-d2b9ee28b3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.620041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96e0b-84e8-467f-bee4-d2b9ee28b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.620041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96e0b-84e8-467f-bee4-d2b9ee28b3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.620041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba96e0b-84e8-467f-bee4-d2b9ee28b3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:55.624999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba96e0b-84e8-467f-bee4-d2b9ee28b3f1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:55.636585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:55.652792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 860/1718] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:55.655335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a01e-6365-4d94-9edf-45eafea8d891 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.655335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a01e-6365-4d94-9edf-45eafea8d891 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.655654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a01e-6365-4d94-9edf-45eafea8d891 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.657503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 861/1719] 10.222.0.40 () {54 vars in 961 bytes} [Wed Aug 10 11:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:22:55.658368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1a01e-6365-4d94-9edf-45eafea8d891 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:55.667650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-01f1a01e-6365-4d94-9edf-45eafea8d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:55.716262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1a01e-6365-4d94-9edf-45eafea8d891 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:55.726892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d7a5d-b22b-46b8-b216-8fee3350463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:55.727696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d7a5d-b22b-46b8-b216-8fee3350463e admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.728039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d7a5d-b22b-46b8-b216-8fee3350463e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.728414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d7a5d-b22b-46b8-b216-8fee3350463e admin admin] PATH_INFO: `/v3/projects/a28d164c8bd54fea866ed7d5695d14c6/users/d831bd44f0aa46d791751593a9f8af94/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.731201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d7a5d-b22b-46b8-b216-8fee3350463e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28d164c8bd54fea866ed7d5695d14c6, user_id=d831bd44f0aa46d791751593a9f8af94, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:55.735489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d7a5d-b22b-46b8-b216-8fee3350463e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:55.751971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 862/1720] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:55 2022] PUT /identity/v3/projects/a28d164c8bd54fea866ed7d5695d14c6/users/d831bd44f0aa46d791751593a9f8af94/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:55.755144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e39cb-b05d-43ba-898f-9e0e104aed7f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.755868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e39cb-b05d-43ba-898f-9e0e104aed7f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.756428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e39cb-b05d-43ba-898f-9e0e104aed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.809805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e405c2ab01b246bfbfdb2ac23378dc2d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.821900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-697e39cb-b05d-43ba-898f-9e0e104aed7f None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:55.823678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-697e39cb-b05d-43ba-898f-9e0e104aed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:55.917082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 863/1721] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Aug 10 11:22:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:55.918384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc92db-5ede-45f9-9f29-e6ff882aa7e0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:55.918768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc92db-5ede-45f9-9f29-e6ff882aa7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:55.919042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc92db-5ede-45f9-9f29-e6ff882aa7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:55.946522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e405c2ab01b246bfbfdb2ac23378dc2d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.949385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e405c2ab01b246bfbfdb2ac23378dc2d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.959982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a8dc92db-5ede-45f9-9f29-e6ff882aa7e0 None None] MFA Rules not processed for user `d831bd44f0aa46d791751593a9f8af94`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:55.962297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a8dc92db-5ede-45f9-9f29-e6ff882aa7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:55.979668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e405c2ab01b246bfbfdb2ac23378dc2d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:55.980725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e405c2ab01b246bfbfdb2ac23378dc2d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:56.017527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 859/1722] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:22:55 2022] DELETE /identity/v3/users/e405c2ab01b246bfbfdb2ac23378dc2d => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:56.021284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:56.021284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:56.085643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 864/1723] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:56.086542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc92db-5ede-45f9-9f29-e6ff882aa7e0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:56.088064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a8dc92db-5ede-45f9-9f29-e6ff882aa7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:56.104151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc92db-5ede-45f9-9f29-e6ff882aa7e0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:56.164834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b447-e1fe-4b49-bda0-46eebb4a91e2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:56.181212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:56.181212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:56.181212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:56.181212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:56.183092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac795-d9e9-4ddd-b8a1-260affc82a36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:56.183233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:56.183732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac795-d9e9-4ddd-b8a1-260affc82a36 service placement] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:56.184015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac795-d9e9-4ddd-b8a1-260affc82a36 service placement] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:56.184287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac795-d9e9-4ddd-b8a1-260affc82a36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:56.186831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-da9ac795-d9e9-4ddd-b8a1-260affc82a36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:56.196124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:56.197454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:56.221409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 865/1724] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:56.221409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:56.221409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:56.221689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ac795-d9e9-4ddd-b8a1-260affc82a36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:56.221689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ac795-d9e9-4ddd-b8a1-260affc82a36 service placement] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:56.230980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 860/1725] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:56.318227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f61c-7910-4293-83fb-65e5e36b77b9 service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:56.323943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a859a5-b928-4566-90aa-f6cd98c7b9c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:56.324676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a859a5-b928-4566-90aa-f6cd98c7b9c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:56.324963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a859a5-b928-4566-90aa-f6cd98c7b9c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:56.325233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a859a5-b928-4566-90aa-f6cd98c7b9c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:56.379020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b8fb-2390-4b73-bcf9-d90688638b37 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:56.379500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b8fb-2390-4b73-bcf9-d90688638b37 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:56.379629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b8fb-2390-4b73-bcf9-d90688638b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:56.418135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8ad7b8fb-2390-4b73-bcf9-d90688638b37 None None] MFA Rules not processed for user `d1bd70f21aed4b2bae45199a5901c00b`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:56.437506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8ad7b8fb-2390-4b73-bcf9-d90688638b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:56.541832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a859a5-b928-4566-90aa-f6cd98c7b9c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:56.547014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a859a5-b928-4566-90aa-f6cd98c7b9c2 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:56.577058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 866/1726] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:56.686468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 861/1727] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:22:56.938683 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a859a5-b928-4566-90aa-f6cd98c7b9c2 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:56.952332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a859a5-b928-4566-90aa-f6cd98c7b9c2 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:56.964183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712d36-4923-4277-b328-8827c16d06ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:56.965591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712d36-4923-4277-b328-8827c16d06ae service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:56.965831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712d36-4923-4277-b328-8827c16d06ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:56.966752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712d36-4923-4277-b328-8827c16d06ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:56.973270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c4712d36-4923-4277-b328-8827c16d06ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:57.038616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:57.114910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712d36-4923-4277-b328-8827c16d06ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:57.118451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712d36-4923-4277-b328-8827c16d06ae service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:57.130315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 867/1728] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:22:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:22:57.184722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:57.259421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7b8fb-2390-4b73-bcf9-d90688638b37 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:57.260899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8ad7b8fb-2390-4b73-bcf9-d90688638b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:57.381717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7b8fb-2390-4b73-bcf9-d90688638b37 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:57.387124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:57.387776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:57.388058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:57.388741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] PATH_INFO: `/v3/projects/290bc4e740ef40f08d623ddc0def56f4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:57.390971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290bc4e740ef40f08d623ddc0def56f4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:57.399342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:57.538133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290bc4e740ef40f08d623ddc0def56f4', 'request_id': 'req-361c74cd-8207-4e93-99a9-76bf64702d04'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:57.545616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290bc4e740ef40f08d623ddc0def56f4', 'request_id': 'req-361c74cd-8207-4e93-99a9-76bf64702d04'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:57.552665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290bc4e740ef40f08d623ddc0def56f4', 'request_id': 'req-361c74cd-8207-4e93-99a9-76bf64702d04'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:57.593517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6f41-5019-4eb1-bd6e-04874303b1f1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:57.594099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6f41-5019-4eb1-bd6e-04874303b1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:57.594464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6f41-5019-4eb1-bd6e-04874303b1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:57.631994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] The token cache is being invalidate because project 290bc4e740ef40f08d623ddc0def56f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:22:57.636468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:57.636468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-361c74cd-8207-4e93-99a9-76bf64702d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:22:57.640595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 862/1729] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:22:57 2022] DELETE /identity/v3/projects/290bc4e740ef40f08d623ddc0def56f4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:22:57.644435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98d487-72a2-4062-9813-3afa8018e18c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:57.645365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98d487-72a2-4062-9813-3afa8018e18c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:57.645841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98d487-72a2-4062-9813-3afa8018e18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:57.662380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9d2c6f41-5019-4eb1-bd6e-04874303b1f1 None None] MFA Rules not processed for user `732e7072abde49de887256b43707c0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:57.666088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9d2c6f41-5019-4eb1-bd6e-04874303b1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:57.669452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5d98d487-72a2-4062-9813-3afa8018e18c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:57.671107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5d98d487-72a2-4062-9813-3afa8018e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:57.747255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 863/1730] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:57.755927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96a55-ada7-435f-86d5-da8ec8c11cb9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:57.756241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96a55-ada7-435f-86d5-da8ec8c11cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:57.757567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96a55-ada7-435f-86d5-da8ec8c11cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:57.765010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 868/1731] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:57.807100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-72b96a55-ada7-435f-86d5-da8ec8c11cb9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:57.808325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-72b96a55-ada7-435f-86d5-da8ec8c11cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:57.832795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 864/1732] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:57.834214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6f41-5019-4eb1-bd6e-04874303b1f1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:57.853059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6f41-5019-4eb1-bd6e-04874303b1f1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:57.864691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:57.865386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:57.865615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:57.866142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:57.868079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:22:57.868608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:57.873213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:57.897382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 869/1733] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:22:57.902464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b96a55-ada7-435f-86d5-da8ec8c11cb9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:57.922429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b96a55-ada7-435f-86d5-da8ec8c11cb9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:57.923527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c89912-8eb6-4502-8dc0-7c34f9dbf099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:57.924765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89912-8eb6-4502-8dc0-7c34f9dbf099 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:57.925153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89912-8eb6-4502-8dc0-7c34f9dbf099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:57.925791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89912-8eb6-4502-8dc0-7c34f9dbf099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:57.926587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c89912-8eb6-4502-8dc0-7c34f9dbf099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:57.928915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c89912-8eb6-4502-8dc0-7c34f9dbf099 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:58.198419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 865/1734] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:57 2022] POST /identity/v3/projects => generated 365 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:58.199220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:58.205624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41c6bf-32e0-4845-be4b-3d27cebfca0d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:58.347340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59c29-3860-47ec-90e2-ad16d9b7dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:58.348141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59c29-3860-47ec-90e2-ad16d9b7dc0c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:58.348545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59c29-3860-47ec-90e2-ad16d9b7dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:58.348824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59c29-3860-47ec-90e2-ad16d9b7dc0c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:58.353001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59c29-3860-47ec-90e2-ad16d9b7dc0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:58.353835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59c29-3860-47ec-90e2-ad16d9b7dc0c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:58.470280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 870/1735] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:58 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:22:58.471505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c89912-8eb6-4502-8dc0-7c34f9dbf099 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:58.481993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c89912-8eb6-4502-8dc0-7c34f9dbf099 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:58.515229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ecf01-f82e-455e-8993-ecab4084f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:58.515870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ecf01-f82e-455e-8993-ecab4084f5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:58.516149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ecf01-f82e-455e-8993-ecab4084f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:58.516453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ecf01-f82e-455e-8993-ecab4084f5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:58.517107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ecf01-f82e-455e-8993-ecab4084f5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:58.518763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ecf01-f82e-455e-8993-ecab4084f5c0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:58.529812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 866/1736] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:58.534228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59c29-3860-47ec-90e2-ad16d9b7dc0c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:58.544697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59c29-3860-47ec-90e2-ad16d9b7dc0c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:58.553027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45741f08-4f38-4739-b98c-dd07d41b5fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:58.553668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741f08-4f38-4739-b98c-dd07d41b5fca admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:58.553955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741f08-4f38-4739-b98c-dd07d41b5fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:58.554228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45741f08-4f38-4739-b98c-dd07d41b5fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:58.555111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45741f08-4f38-4739-b98c-dd07d41b5fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:58.556756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45741f08-4f38-4739-b98c-dd07d41b5fca admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:58.588596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ecf01-f82e-455e-8993-ecab4084f5c0 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:58.593516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 871/1737] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:58.611430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ecf01-f82e-455e-8993-ecab4084f5c0 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:58.617991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd1336-dc45-4d68-b73e-3d91d8cf644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:58.624876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd1336-dc45-4d68-b73e-3d91d8cf644c admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:58.624876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd1336-dc45-4d68-b73e-3d91d8cf644c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:58.624876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd1336-dc45-4d68-b73e-3d91d8cf644c admin admin] PATH_INFO: `/v3/projects/57e4d2d499194ad1912b7cb4d71ff226/users/0478faf3f5204ceb897f9ba778a370fd/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:58.637660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd1336-dc45-4d68-b73e-3d91d8cf644c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e4d2d499194ad1912b7cb4d71ff226, user_id=0478faf3f5204ceb897f9ba778a370fd, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:58.648158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd1336-dc45-4d68-b73e-3d91d8cf644c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:58.787362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 867/1738] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:58 2022] PUT /identity/v3/projects/57e4d2d499194ad1912b7cb4d71ff226/users/0478faf3f5204ceb897f9ba778a370fd/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:22:58.799682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c01d-9809-451e-b634-e2e9cc8d1aac None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:58.801025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c01d-9809-451e-b634-e2e9cc8d1aac None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:58.801213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c01d-9809-451e-b634-e2e9cc8d1aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:58.870985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1126c01d-9809-451e-b634-e2e9cc8d1aac None None] MFA Rules not processed for user `0478faf3f5204ceb897f9ba778a370fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:22:58.872249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1126c01d-9809-451e-b634-e2e9cc8d1aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:22:58.945599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:59.058814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 872/1739] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:22:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:22:59.058983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd1336-dc45-4d68-b73e-3d91d8cf644c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:59.244195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd1336-dc45-4d68-b73e-3d91d8cf644c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:59.254614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ba756-e8bf-49b4-a0ac-48e3e83bc2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:59.257718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ba756-e8bf-49b4-a0ac-48e3e83bc2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:59.258981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ba756-e8bf-49b4-a0ac-48e3e83bc2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:59.259241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ba756-e8bf-49b4-a0ac-48e3e83bc2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:59.262747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ba756-e8bf-49b4-a0ac-48e3e83bc2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:59.267271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ba756-e8bf-49b4-a0ac-48e3e83bc2cb admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:59.408804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 868/1740] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:22:59 2022] POST /identity/v3/projects => generated 365 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:59.412945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c01d-9809-451e-b634-e2e9cc8d1aac None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:59.440398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c01d-9809-451e-b634-e2e9cc8d1aac None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:59.674847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856384d4-9108-4ccd-854d-70f97d7f80dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:59.676039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856384d4-9108-4ccd-854d-70f97d7f80dc admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:59.679312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856384d4-9108-4ccd-854d-70f97d7f80dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:59.679995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856384d4-9108-4ccd-854d-70f97d7f80dc admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:59.681794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856384d4-9108-4ccd-854d-70f97d7f80dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:59.687069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856384d4-9108-4ccd-854d-70f97d7f80dc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:59.814388 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 873/1741] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:22:59 2022] POST /identity/v3/users => generated 289 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:22:59.818140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ba756-e8bf-49b4-a0ac-48e3e83bc2cb admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:59.847792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ba756-e8bf-49b4-a0ac-48e3e83bc2cb admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:59.869849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b582-cdfb-454c-99c8-3b424fb236f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:59.871520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b582-cdfb-454c-99c8-3b424fb236f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:59.878322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b582-cdfb-454c-99c8-3b424fb236f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:59.879938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6b582-cdfb-454c-99c8-3b424fb236f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:22:59.880720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b582-cdfb-454c-99c8-3b424fb236f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:22:59.882388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6b582-cdfb-454c-99c8-3b424fb236f9 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:22:59.914426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 869/1742] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:22:59.929600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856384d4-9108-4ccd-854d-70f97d7f80dc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:22:59.947825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856384d4-9108-4ccd-854d-70f97d7f80dc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:22:59.963054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860659ac-b16a-4e4b-8e4f-0475d1d80c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:22:59.964560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860659ac-b16a-4e4b-8e4f-0475d1d80c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:22:59.965484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860659ac-b16a-4e4b-8e4f-0475d1d80c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:22:59.967685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860659ac-b16a-4e4b-8e4f-0475d1d80c5d admin admin] PATH_INFO: `/v3/projects/4fbec544c85943de9f733c4936398ece/users/a19428b5bec744f7b74ab814a07d47c3/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:00.017759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860659ac-b16a-4e4b-8e4f-0475d1d80c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbec544c85943de9f733c4936398ece, user_id=a19428b5bec744f7b74ab814a07d47c3, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:00.020936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860659ac-b16a-4e4b-8e4f-0475d1d80c5d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:00.160854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 874/1743] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:22:59 2022] PUT /identity/v3/projects/4fbec544c85943de9f733c4936398ece/users/a19428b5bec744f7b74ab814a07d47c3/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:00.165133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b582-cdfb-454c-99c8-3b424fb236f9 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:00.197379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6b582-cdfb-454c-99c8-3b424fb236f9 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:00.301819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba295b87-b745-4ad1-b0e0-0e258c33195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:00.302478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295b87-b745-4ad1-b0e0-0e258c33195e admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:00.302767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295b87-b745-4ad1-b0e0-0e258c33195e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:00.303286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295b87-b745-4ad1-b0e0-0e258c33195e admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:00.304068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba295b87-b745-4ad1-b0e0-0e258c33195e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:00.305796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba295b87-b745-4ad1-b0e0-0e258c33195e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:00.320376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 870/1744] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:00.321575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860659ac-b16a-4e4b-8e4f-0475d1d80c5d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:00.332747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860659ac-b16a-4e4b-8e4f-0475d1d80c5d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:00.337571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:00.338312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:00.338682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:00.339025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] PATH_INFO: `/v3/projects/4fbec544c85943de9f733c4936398ece/users/a19428b5bec744f7b74ab814a07d47c3/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:00.341403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbec544c85943de9f733c4936398ece, user_id=a19428b5bec744f7b74ab814a07d47c3, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:00.348246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:00.370326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 875/1745] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:00 2022] PUT /identity/v3/projects/4fbec544c85943de9f733c4936398ece/users/a19428b5bec744f7b74ab814a07d47c3/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:00.387068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd29-c1cd-4408-92c6-ad6bab7fdfed None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:00.387068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd29-c1cd-4408-92c6-ad6bab7fdfed None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:00.387068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd29-c1cd-4408-92c6-ad6bab7fdfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:00.441796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8098dd29-c1cd-4408-92c6-ad6bab7fdfed None None] MFA Rules not processed for user `a19428b5bec744f7b74ab814a07d47c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:00.443028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8098dd29-c1cd-4408-92c6-ad6bab7fdfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:00.452586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:00.635720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 871/1746] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:00.653891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:00.661874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:00.880572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaed0e5-85f6-4b09-a884-c492eb18c6e6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:00.894436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:00.895412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:00.895703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:00.895962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:00.929971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:00.932043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:00.975738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 876/1747] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:01.918495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:02.187954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb2ddb-2975-4f81-b8c3-919e0316bc0d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:02.188593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb2ddb-2975-4f81-b8c3-919e0316bc0d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:02.189058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb2ddb-2975-4f81-b8c3-919e0316bc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:02.225937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:02.311199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e2cb2ddb-2975-4f81-b8c3-919e0316bc0d None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:02.312789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e2cb2ddb-2975-4f81-b8c3-919e0316bc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:02.491554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 872/1748] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:23:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:02.866347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:02.867860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:03.151338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139385bb-08dd-49ef-bb49-a54019f64cc9 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:03.171435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31c60-3aef-4478-9426-cf0db755d3b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:03.172417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31c60-3aef-4478-9426-cf0db755d3b2 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:03.172939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31c60-3aef-4478-9426-cf0db755d3b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:03.173385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31c60-3aef-4478-9426-cf0db755d3b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:03.189999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31c60-3aef-4478-9426-cf0db755d3b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:03.191865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31c60-3aef-4478-9426-cf0db755d3b2 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:03.223101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 877/1749] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:23:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:03.811278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:04.068550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb2ddb-2975-4f81-b8c3-919e0316bc0d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:04.248727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb2ddb-2975-4f81-b8c3-919e0316bc0d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:04.267460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:04.268493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:04.268966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:04.269644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] PATH_INFO: `/v3/users/0478faf3f5204ceb897f9ba778a370fd` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:04.277603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0478faf3f5204ceb897f9ba778a370fd)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:04.288289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:04.345173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:04.617621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0478faf3f5204ceb897f9ba778a370fd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:04.689694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26698ace-49b0-41a7-8324-697d83ee22ba None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:04.690215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26698ace-49b0-41a7-8324-697d83ee22ba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:04.690669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26698ace-49b0-41a7-8324-697d83ee22ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:04.736776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0478faf3f5204ceb897f9ba778a370fd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:04.736776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0478faf3f5204ceb897f9ba778a370fd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:04.759403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-26698ace-49b0-41a7-8324-697d83ee22ba None None] MFA Rules not processed for user `512aab5a19c94651bfa0f634244dbdab`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:04.760656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-26698ace-49b0-41a7-8324-697d83ee22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:04.780721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0478faf3f5204ceb897f9ba778a370fd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:04.787459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bef599a3-b0a9-4596-8324-dd46ab3592c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0478faf3f5204ceb897f9ba778a370fd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:04.847786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 873/1750] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:04 2022] DELETE /identity/v3/users/0478faf3f5204ceb897f9ba778a370fd => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:04.849951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e1273-ea91-4596-b0ca-77b6e7d8f281 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:04.855090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e1273-ea91-4596-b0ca-77b6e7d8f281 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:04.855453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e1273-ea91-4596-b0ca-77b6e7d8f281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:04.898672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-9e4e1273-ea91-4596-b0ca-77b6e7d8f281 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:04.899857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9e4e1273-ea91-4596-b0ca-77b6e7d8f281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:04.987579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 878/1751] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 10 11:23:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:05.126125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 874/1752] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:05.153334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26698ace-49b0-41a7-8324-697d83ee22ba None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:05.157625 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-26698ace-49b0-41a7-8324-697d83ee22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:05.173305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:05.197902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26698ace-49b0-41a7-8324-697d83ee22ba None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:05.212031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e1273-ea91-4596-b0ca-77b6e7d8f281 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:05.424410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:05.429681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:05.429681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:05.429681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:05.447139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:05.451484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:05.478333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e1273-ea91-4596-b0ca-77b6e7d8f281 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:05.486990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 879/1753] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:05.489297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:05.500517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:05.501682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:05.506453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:05.506904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:05.508841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:05.533843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e520a4-c870-4f72-afe3-d7398a2237ff service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:05.534136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:05.536287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:05.549788 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36b4d-800b-440d-a182-5cf0b182ede6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:05.551533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36b4d-800b-440d-a182-5cf0b182ede6 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:05.555995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36b4d-800b-440d-a182-5cf0b182ede6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:05.556625 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36b4d-800b-440d-a182-5cf0b182ede6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:05.588453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36b4d-800b-440d-a182-5cf0b182ede6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:05.590427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 875/1754] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:05.593990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36b4d-800b-440d-a182-5cf0b182ede6 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:05.618254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 880/1755] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:06.378057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:06.568936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:07.009232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:08.126446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:08.127740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:08.158769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caca4a-ec01-46c7-a218-85d1893dfcb9 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:08.164655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:08.165577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:08.166076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:08.166564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] PATH_INFO: `/v3/projects/57e4d2d499194ad1912b7cb4d71ff226` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:08.169999 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e4d2d499194ad1912b7cb4d71ff226)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:08.172185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:08.350289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e4d2d499194ad1912b7cb4d71ff226', 'request_id': 'req-63417fbf-5ac6-4e60-a3cf-93b979c14f87'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:08.362023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e4d2d499194ad1912b7cb4d71ff226', 'request_id': 'req-63417fbf-5ac6-4e60-a3cf-93b979c14f87'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:08.383730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e4d2d499194ad1912b7cb4d71ff226', 'request_id': 'req-63417fbf-5ac6-4e60-a3cf-93b979c14f87'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:08.471231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] The token cache is being invalidate because project 57e4d2d499194ad1912b7cb4d71ff226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:08.474687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:08.474687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63417fbf-5ac6-4e60-a3cf-93b979c14f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:08.475177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 876/1756] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:08 2022] DELETE /identity/v3/projects/57e4d2d499194ad1912b7cb4d71ff226 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:08.479450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36b4d-800b-440d-a182-5cf0b182ede6 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:08.505527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36b4d-800b-440d-a182-5cf0b182ede6 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:08.606603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8315ef5-10a8-48a0-9b6f-7ab92fc5ad92 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:08.607447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8315ef5-10a8-48a0-9b6f-7ab92fc5ad92 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:08.607761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8315ef5-10a8-48a0-9b6f-7ab92fc5ad92 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:08.617024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 877/1757] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:23:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:23:08.644514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69bc81-3466-49ae-88e1-420cbeed7365 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:08.647065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69bc81-3466-49ae-88e1-420cbeed7365 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:08.647065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69bc81-3466-49ae-88e1-420cbeed7365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:08.647259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:08.647259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:08.647259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:08.647259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] PATH_INFO: `/v3/users/a19428b5bec744f7b74ab814a07d47c3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:08.648784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19428b5bec744f7b74ab814a07d47c3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:08.650989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:08.693490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-fc69bc81-3466-49ae-88e1-420cbeed7365 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:08.696247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fc69bc81-3466-49ae-88e1-420cbeed7365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:08.839190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 878/1758] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:23:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:08.840721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69bc81-3466-49ae-88e1-420cbeed7365 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:08.843582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fc69bc81-3466-49ae-88e1-420cbeed7365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:08.859361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69bc81-3466-49ae-88e1-420cbeed7365 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:08.864675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:08.865329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:08.865639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:08.865956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] PATH_INFO: `/v3/users/eacc294b7f4e40ebb8f9f98b5f2e097e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:08.867201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eacc294b7f4e40ebb8f9f98b5f2e097e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:08.869755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:08.885551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:09.015211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:09.052476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19428b5bec744f7b74ab814a07d47c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.053203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19428b5bec744f7b74ab814a07d47c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.178171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19428b5bec744f7b74ab814a07d47c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.189524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eacc294b7f4e40ebb8f9f98b5f2e097e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.195083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19428b5bec744f7b74ab814a07d47c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.218399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19428b5bec744f7b74ab814a07d47c3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.231471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 881/1759] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:08 2022] DELETE /identity/v3/users/a19428b5bec744f7b74ab814a07d47c3 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:09.231471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:09.233144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:09.274471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eacc294b7f4e40ebb8f9f98b5f2e097e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.277147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eacc294b7f4e40ebb8f9f98b5f2e097e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.302607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eacc294b7f4e40ebb8f9f98b5f2e097e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.303669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-388e0ac4-b780-4ef0-83bc-d91d9374701c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eacc294b7f4e40ebb8f9f98b5f2e097e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:09.343862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 879/1760] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:08 2022] DELETE /identity/v3/users/eacc294b7f4e40ebb8f9f98b5f2e097e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:09.351321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc324-ce1b-456c-a729-ccd8dbfab472 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:09.351665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc324-ce1b-456c-a729-ccd8dbfab472 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:09.351983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc324-ce1b-456c-a729-ccd8dbfab472 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:09.354693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 880/1761] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:23:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:23:09.358745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a878db8-10e9-44eb-a5a5-1353c3c272ac None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:09.359127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a878db8-10e9-44eb-a5a5-1353c3c272ac None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:09.359476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a878db8-10e9-44eb-a5a5-1353c3c272ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:09.429849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2a878db8-10e9-44eb-a5a5-1353c3c272ac None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:09.432373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2a878db8-10e9-44eb-a5a5-1353c3c272ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:09.458809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b49db-1450-4c04-b172-a4ac8799bd5a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:09.583380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 881/1762] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:09.583380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527b85-080f-424f-9582-8484defe5467 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:09.583380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527b85-080f-424f-9582-8484defe5467 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:09.583380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527b85-080f-424f-9582-8484defe5467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:09.636130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-35527b85-080f-424f-9582-8484defe5467 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:09.638939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-35527b85-080f-424f-9582-8484defe5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:09.664275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:09.666507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:09.666958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:09.667522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:09.673122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:09.705259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:09.707150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:09.752619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 882/1763] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:09.768550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:09.768550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:09.779544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fe81b-0838-4251-b4a8-e497194828df service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:09.805079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:09.805797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:09.806083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:09.806364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] PATH_INFO: `/v3/users/612742e1ffd949f7b79c1de27a510d90` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:09.814090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 882/1764] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:23:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:09.814978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527b85-080f-424f-9582-8484defe5467 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:09.818865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=612742e1ffd949f7b79c1de27a510d90)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:09.829272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-35527b85-080f-424f-9582-8484defe5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:09.829802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:09.932106 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527b85-080f-424f-9582-8484defe5467 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:09.938203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17917246-ee5e-4b43-8c15-bd74120dc810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:09.938961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17917246-ee5e-4b43-8c15-bd74120dc810 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:09.939254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17917246-ee5e-4b43-8c15-bd74120dc810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:09.939620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17917246-ee5e-4b43-8c15-bd74120dc810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:09.987931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17917246-ee5e-4b43-8c15-bd74120dc810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:10.000355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17917246-ee5e-4b43-8c15-bd74120dc810 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:10.039271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 883/1765] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:10.133717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612742e1ffd949f7b79c1de27a510d90'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:10.134647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612742e1ffd949f7b79c1de27a510d90'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:10.258727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612742e1ffd949f7b79c1de27a510d90'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:10.288186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612742e1ffd949f7b79c1de27a510d90'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:10.320422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612742e1ffd949f7b79c1de27a510d90'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:10.335124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 883/1766] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:09 2022] DELETE /identity/v3/users/612742e1ffd949f7b79c1de27a510d90 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:10.350419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e0d4-569f-4a6a-8798-28c6492fa1ec None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:10.350419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e0d4-569f-4a6a-8798-28c6492fa1ec None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:10.350419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e0d4-569f-4a6a-8798-28c6492fa1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:10.383684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d651e0d4-569f-4a6a-8798-28c6492fa1ec None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:10.385342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d651e0d4-569f-4a6a-8798-28c6492fa1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:10.464291 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:10.529778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:10.533177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:10.600113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 884/1767] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:10.634191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651e0d4-569f-4a6a-8798-28c6492fa1ec None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:10.636032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d651e0d4-569f-4a6a-8798-28c6492fa1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:10.722659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c51fcf-6567-4af1-bd5c-d94d8511eddf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:10.735202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:10.737027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:10.738357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:10.739283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:10.746248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:10.767528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:10.771116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:10.785195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651e0d4-569f-4a6a-8798-28c6492fa1ec None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:10.797857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 884/1768] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:10.799475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:10.807861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:10.808601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:10.808899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:10.822413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:10.824095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:10.848482 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 885/1769] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:11.224291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:12.032912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:12.034519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:12.054498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc092cb0-bea2-4900-a002-1748e9173901 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:12.061046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:12.062521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:12.083666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:12.084335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:12.084830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:12.085119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] PATH_INFO: `/v3/projects/d2f0f3b467cc487ca1abf8a6b84a3560` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:12.086454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f0f3b467cc487ca1abf8a6b84a3560)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:12.088559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:12.093772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774f292-b7b5-42ff-b217-aee9d35730aa service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:12.108929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:12.111620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:12.111620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:12.111620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] PATH_INFO: `/v3/projects/4fbec544c85943de9f733c4936398ece` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:12.112036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbec544c85943de9f733c4936398ece)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:12.114907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:12.297196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f0f3b467cc487ca1abf8a6b84a3560', 'request_id': 'req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.297398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbec544c85943de9f733c4936398ece', 'request_id': 'req-fb334c29-f132-4334-b3f1-dad004fd96fd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.307147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f0f3b467cc487ca1abf8a6b84a3560', 'request_id': 'req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.317951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbec544c85943de9f733c4936398ece', 'request_id': 'req-fb334c29-f132-4334-b3f1-dad004fd96fd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.321420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f0f3b467cc487ca1abf8a6b84a3560', 'request_id': 'req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.328686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbec544c85943de9f733c4936398ece', 'request_id': 'req-fb334c29-f132-4334-b3f1-dad004fd96fd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.477078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] The token cache is being invalidate because project d2f0f3b467cc487ca1abf8a6b84a3560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:12.477621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.478737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.480615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 885/1770] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:12 2022] DELETE /identity/v3/projects/d2f0f3b467cc487ca1abf8a6b84a3560 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:12.481739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:12.486317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:12.579320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02dbc-ed19-44bd-afb4-5125b23a9f3e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:12.604283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] The token cache is being invalidate because project 4fbec544c85943de9f733c4936398ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:12.604677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.606250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.610922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 886/1771] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:12 2022] DELETE /identity/v3/projects/4fbec544c85943de9f733c4936398ece => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:12.612003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:12.615587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:12.727902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:12.729594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:12.730101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:12.730618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] PATH_INFO: `/v3/projects/2e19bc8ef290421d9e56f3a8331e4974` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:12.733714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e19bc8ef290421d9e56f3a8331e4974)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:12.736776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:12.741988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb334c29-f132-4334-b3f1-dad004fd96fd admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:12.760435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:12.761206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:12.761497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:12.761773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] PATH_INFO: `/v3/users/d831bd44f0aa46d791751593a9f8af94` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:12.767256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d831bd44f0aa46d791751593a9f8af94)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:12.770584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:12.866616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e19bc8ef290421d9e56f3a8331e4974', 'request_id': 'req-a2427064-55df-4be1-898d-4b8cf87d39f1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.892650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e19bc8ef290421d9e56f3a8331e4974', 'request_id': 'req-a2427064-55df-4be1-898d-4b8cf87d39f1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.922512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e19bc8ef290421d9e56f3a8331e4974', 'request_id': 'req-a2427064-55df-4be1-898d-4b8cf87d39f1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:12.958037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:13.021088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd831bd44f0aa46d791751593a9f8af94'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.033971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] The token cache is being invalidate because project 2e19bc8ef290421d9e56f3a8331e4974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:13.034554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.037355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2427064-55df-4be1-898d-4b8cf87d39f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.041922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 886/1772] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:12 2022] DELETE /identity/v3/projects/2e19bc8ef290421d9e56f3a8331e4974 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:13.043354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54375d5f-9725-4795-b427-9aade8c08a95 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:13.048491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54375d5f-9725-4795-b427-9aade8c08a95 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:13.048800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54375d5f-9725-4795-b427-9aade8c08a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:13.101633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-54375d5f-9725-4795-b427-9aade8c08a95 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:13.107842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-54375d5f-9725-4795-b427-9aade8c08a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:13.116368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd831bd44f0aa46d791751593a9f8af94'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.122770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd831bd44f0aa46d791751593a9f8af94'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.141128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd831bd44f0aa46d791751593a9f8af94'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.141893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd831bd44f0aa46d791751593a9f8af94'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.164517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 887/1773] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:12 2022] DELETE /identity/v3/users/d831bd44f0aa46d791751593a9f8af94 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:13.166090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:13.167530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:13.286922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 887/1774] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:13.296269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cf886-6782-4369-bdd9-6855e5226ef1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:13.296805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cf886-6782-4369-bdd9-6855e5226ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:13.297224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cf886-6782-4369-bdd9-6855e5226ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:13.341096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-575cf886-6782-4369-bdd9-6855e5226ef1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:13.343526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-575cf886-6782-4369-bdd9-6855e5226ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:13.354495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0e184-4abd-486f-89f7-5def4093ce35 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:13.376995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 888/1775] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:13.380554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:13.381473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:13.381763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:13.382087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] PATH_INFO: `/v3/users/952b83801bfb4ae782cc0b4cf2812f38` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:13.382345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cf886-6782-4369-bdd9-6855e5226ef1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:13.383333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] RBAC: Authorizing `identity:delete_user(user_id=952b83801bfb4ae782cc0b4cf2812f38)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:13.385666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:13.405072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cf886-6782-4369-bdd9-6855e5226ef1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:13.431437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:13.432383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:13.432695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:13.432981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:13.433658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:13.434046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:13.436423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:13.452085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 889/1776] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:13.459693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:13.472006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95733-f8b4-4951-9c62-e7430cc3831f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:13.477543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4c42b-521c-4905-8952-472be3f1030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:13.478492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4c42b-521c-4905-8952-472be3f1030c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:13.479381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4c42b-521c-4905-8952-472be3f1030c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:13.479937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4c42b-521c-4905-8952-472be3f1030c admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:13.487132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4c42b-521c-4905-8952-472be3f1030c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:13.490018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4c42b-521c-4905-8952-472be3f1030c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:13.642218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 890/1777] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:13 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:13.646394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4c42b-521c-4905-8952-472be3f1030c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:13.648735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952b83801bfb4ae782cc0b4cf2812f38'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.726989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952b83801bfb4ae782cc0b4cf2812f38'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.727921 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952b83801bfb4ae782cc0b4cf2812f38'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.755639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952b83801bfb4ae782cc0b4cf2812f38'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.756980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952b83801bfb4ae782cc0b4cf2812f38'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:13.797695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4c42b-521c-4905-8952-472be3f1030c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:13.804494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad237ff-2bc2-44ae-92f2-c0ece09640b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:13.805225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad237ff-2bc2-44ae-92f2-c0ece09640b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:13.805907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad237ff-2bc2-44ae-92f2-c0ece09640b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:13.806814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad237ff-2bc2-44ae-92f2-c0ece09640b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:13.807894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad237ff-2bc2-44ae-92f2-c0ece09640b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:13.810540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad237ff-2bc2-44ae-92f2-c0ece09640b3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:13.816537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 888/1778] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:13 2022] DELETE /identity/v3/users/952b83801bfb4ae782cc0b4cf2812f38 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:13.947504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 891/1779] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:13 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:13.955026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:13.955026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:14.005464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:14.076839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7badbd-fcfe-47bb-8beb-af35661c02af admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:14.084181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac8535-8e79-41b4-971c-8b2fba2587c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:14.085310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac8535-8e79-41b4-971c-8b2fba2587c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:14.085682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac8535-8e79-41b4-971c-8b2fba2587c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:14.086051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac8535-8e79-41b4-971c-8b2fba2587c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:14.086974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac8535-8e79-41b4-971c-8b2fba2587c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:14.089062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac8535-8e79-41b4-971c-8b2fba2587c7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:14.106223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 889/1780] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:14.107662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad237ff-2bc2-44ae-92f2-c0ece09640b3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:14.118535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad237ff-2bc2-44ae-92f2-c0ece09640b3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:14.123987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1621a2-2acc-4f51-9d30-fa877f9e6cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:14.124649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1621a2-2acc-4f51-9d30-fa877f9e6cea admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:14.124934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1621a2-2acc-4f51-9d30-fa877f9e6cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:14.125189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1621a2-2acc-4f51-9d30-fa877f9e6cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:14.125854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1621a2-2acc-4f51-9d30-fa877f9e6cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:14.127535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1621a2-2acc-4f51-9d30-fa877f9e6cea admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:14.139326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 892/1781] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:14.143654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac8535-8e79-41b4-971c-8b2fba2587c7 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:14.155279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac8535-8e79-41b4-971c-8b2fba2587c7 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:14.167410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2ece0-d9fd-450d-abb5-fc9fd46678b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:14.168381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2ece0-d9fd-450d-abb5-fc9fd46678b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:14.168381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2ece0-d9fd-450d-abb5-fc9fd46678b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:14.168676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2ece0-d9fd-450d-abb5-fc9fd46678b3 admin admin] PATH_INFO: `/v3/projects/671cbf1337444f589bdf831d99d1eaf4/users/186209a0a74a4449a2467438f097871e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:14.204463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2ece0-d9fd-450d-abb5-fc9fd46678b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671cbf1337444f589bdf831d99d1eaf4, user_id=186209a0a74a4449a2467438f097871e, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:14.207992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2ece0-d9fd-450d-abb5-fc9fd46678b3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:14.312185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 890/1782] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:14 2022] PUT /identity/v3/projects/671cbf1337444f589bdf831d99d1eaf4/users/186209a0a74a4449a2467438f097871e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:14.329634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee727c0-1290-49b4-9582-17a0c77f1ed5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:14.331838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee727c0-1290-49b4-9582-17a0c77f1ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:14.332593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee727c0-1290-49b4-9582-17a0c77f1ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:14.385654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3ee727c0-1290-49b4-9582-17a0c77f1ed5 None None] MFA Rules not processed for user `186209a0a74a4449a2467438f097871e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:14.387159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3ee727c0-1290-49b4-9582-17a0c77f1ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:14.483162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 893/1783] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:14.491765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2ece0-d9fd-450d-abb5-fc9fd46678b3 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:14.578646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee727c0-1290-49b4-9582-17a0c77f1ed5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:14.589507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3ee727c0-1290-49b4-9582-17a0c77f1ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:14.643262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2ece0-d9fd-450d-abb5-fc9fd46678b3 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:14.681612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dcbd6-7f62-4735-97fa-5963b1ce87d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:14.682586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dcbd6-7f62-4735-97fa-5963b1ce87d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:14.683105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dcbd6-7f62-4735-97fa-5963b1ce87d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:14.683564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dcbd6-7f62-4735-97fa-5963b1ce87d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:14.685422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dcbd6-7f62-4735-97fa-5963b1ce87d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:14.687864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dcbd6-7f62-4735-97fa-5963b1ce87d3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:14.759132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee727c0-1290-49b4-9582-17a0c77f1ed5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:14.770831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:14.772451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:14.772834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:14.773879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] PATH_INFO: `/v3/projects/a28d164c8bd54fea866ed7d5695d14c6` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:14.774805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28d164c8bd54fea866ed7d5695d14c6)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:14.777399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:15.673286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 891/1784] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:14 2022] POST /identity/v3/projects => generated 393 bytes in 1179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:15.675093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dcbd6-7f62-4735-97fa-5963b1ce87d3 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:15.696957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28d164c8bd54fea866ed7d5695d14c6', 'request_id': 'req-152ebd6f-f4be-4ccf-be08-f2a7493193a0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:15.717826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28d164c8bd54fea866ed7d5695d14c6', 'request_id': 'req-152ebd6f-f4be-4ccf-be08-f2a7493193a0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:15.730651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28d164c8bd54fea866ed7d5695d14c6', 'request_id': 'req-152ebd6f-f4be-4ccf-be08-f2a7493193a0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:15.759479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dcbd6-7f62-4735-97fa-5963b1ce87d3 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:15.795330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] The token cache is being invalidate because project a28d164c8bd54fea866ed7d5695d14c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:15.801863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:15.801863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-152ebd6f-f4be-4ccf-be08-f2a7493193a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:15.801863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 894/1785] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:14 2022] DELETE /identity/v3/projects/a28d164c8bd54fea866ed7d5695d14c6 => generated 0 bytes in 1221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:15.804257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3a33-6487-4d2a-8667-8a6697dc9f73 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:15.804800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3a33-6487-4d2a-8667-8a6697dc9f73 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:15.805191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb3a33-6487-4d2a-8667-8a6697dc9f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:15.831710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4cdb3a33-6487-4d2a-8667-8a6697dc9f73 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:15.833464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4cdb3a33-6487-4d2a-8667-8a6697dc9f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:15.836909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:15.837683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:15.838065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:15.838433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:15.839182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:15.842184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:15.847124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 895/1786] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:15.855678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6607-576c-419d-95a3-da4370ea8ac4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:15.855964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6607-576c-419d-95a3-da4370ea8ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:15.856347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf6607-576c-419d-95a3-da4370ea8ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:15.879138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ccaf6607-576c-419d-95a3-da4370ea8ac4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:15.882355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ccaf6607-576c-419d-95a3-da4370ea8ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:15.889048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 896/1787] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:15.893490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf6607-576c-419d-95a3-da4370ea8ac4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:15.904290 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf6607-576c-419d-95a3-da4370ea8ac4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:15.916781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:15.916781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:15.916781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:15.916781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:15.917273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:15.917273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:15.917273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:15.927114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 897/1788] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:15.932129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:15.939744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 892/1789] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:15 2022] POST /identity/v3/users => generated 303 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:15.945037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd0d5-e7be-4989-bc69-d052049b54b3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:15.946453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:15.948396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:15.950522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:15.951225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:15.951573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:15.952117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:15.952645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:15.955034 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:15.962718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd4ed2-31a0-4105-b1c9-07ed6e12d94d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:15.968158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d947b8-4948-484c-a243-d55e9402780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:15.979972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d947b8-4948-484c-a243-d55e9402780b admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:15.979972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d947b8-4948-484c-a243-d55e9402780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:15.979972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d947b8-4948-484c-a243-d55e9402780b admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:15.979972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d947b8-4948-484c-a243-d55e9402780b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:15.979972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d947b8-4948-484c-a243-d55e9402780b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:15.981694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 893/1790] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:15.986458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d947b8-4948-484c-a243-d55e9402780b admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:15.999743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d947b8-4948-484c-a243-d55e9402780b admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.003293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf3d44-d490-4b01-bcab-4706defef63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.004087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf3d44-d490-4b01-bcab-4706defef63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.004522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf3d44-d490-4b01-bcab-4706defef63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.004859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf3d44-d490-4b01-bcab-4706defef63f admin admin] PATH_INFO: `/v3/projects/02ac79c6bf8944f6b36b9b1b7a02e56f/users/063305dcc23849dab426bc30242a32c4/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.028054 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf3d44-d490-4b01-bcab-4706defef63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ac79c6bf8944f6b36b9b1b7a02e56f, user_id=063305dcc23849dab426bc30242a32c4, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.031669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf3d44-d490-4b01-bcab-4706defef63f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.107053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 898/1791] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:15 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:16.108803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.111745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:16.118012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 894/1792] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:15 2022] PUT /identity/v3/projects/02ac79c6bf8944f6b36b9b1b7a02e56f/users/063305dcc23849dab426bc30242a32c4/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:16.118012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf3d44-d490-4b01-bcab-4706defef63f admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.195361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a21b6-5c31-490a-ad5f-817a747a8ad2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.199113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf3d44-d490-4b01-bcab-4706defef63f admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.201042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.201727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.202135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.202438 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] PATH_INFO: `/v3/projects/2ade44ff6e7b419d8747a1feef81bbb3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.203801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ade44ff6e7b419d8747a1feef81bbb3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.205798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da913503-2e7d-41bb-a1cd-978075bc86d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.206038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.206407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da913503-2e7d-41bb-a1cd-978075bc86d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.208349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da913503-2e7d-41bb-a1cd-978075bc86d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.208349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da913503-2e7d-41bb-a1cd-978075bc86d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.208349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da913503-2e7d-41bb-a1cd-978075bc86d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.209670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da913503-2e7d-41bb-a1cd-978075bc86d6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.333214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 895/1793] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:16 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:16.334543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da913503-2e7d-41bb-a1cd-978075bc86d6 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.345715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da913503-2e7d-41bb-a1cd-978075bc86d6 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.350814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933f3b9-e286-49ec-8139-aee1d9de1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.351412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933f3b9-e286-49ec-8139-aee1d9de1ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.351689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933f3b9-e286-49ec-8139-aee1d9de1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.351960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933f3b9-e286-49ec-8139-aee1d9de1ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.352636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933f3b9-e286-49ec-8139-aee1d9de1ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.354329 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933f3b9-e286-49ec-8139-aee1d9de1ac0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.364294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 896/1794] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:16.365487 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933f3b9-e286-49ec-8139-aee1d9de1ac0 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.368236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ade44ff6e7b419d8747a1feef81bbb3', 'request_id': 'req-ae23d0dd-8f00-464a-9af9-ab8861b019c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:16.374923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ade44ff6e7b419d8747a1feef81bbb3', 'request_id': 'req-ae23d0dd-8f00-464a-9af9-ab8861b019c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:16.375426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933f3b9-e286-49ec-8139-aee1d9de1ac0 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.381505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ade44ff6e7b419d8747a1feef81bbb3', 'request_id': 'req-ae23d0dd-8f00-464a-9af9-ab8861b019c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:16.431269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0920860-bdd8-4a2d-986c-72ef21ac861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.431880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0920860-bdd8-4a2d-986c-72ef21ac861c admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.432154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0920860-bdd8-4a2d-986c-72ef21ac861c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.432460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0920860-bdd8-4a2d-986c-72ef21ac861c admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.433101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0920860-bdd8-4a2d-986c-72ef21ac861c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.435277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0920860-bdd8-4a2d-986c-72ef21ac861c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.445114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 897/1795] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:16.445988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0920860-bdd8-4a2d-986c-72ef21ac861c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.456209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0920860-bdd8-4a2d-986c-72ef21ac861c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.461097 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9a604-98a8-4c24-a037-ea4e78dc9505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.461755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a604-98a8-4c24-a037-ea4e78dc9505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.462040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a604-98a8-4c24-a037-ea4e78dc9505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.462665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9a604-98a8-4c24-a037-ea4e78dc9505 admin admin] PATH_INFO: `/v3/projects/02ac79c6bf8944f6b36b9b1b7a02e56f/users/063305dcc23849dab426bc30242a32c4/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.464967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a604-98a8-4c24-a037-ea4e78dc9505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ac79c6bf8944f6b36b9b1b7a02e56f, user_id=063305dcc23849dab426bc30242a32c4, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.468019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9a604-98a8-4c24-a037-ea4e78dc9505 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.477005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] The token cache is being invalidate because project 2ade44ff6e7b419d8747a1feef81bbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:16.477005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:16.477005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:16.477005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 899/1796] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:16 2022] DELETE /identity/v3/projects/2ade44ff6e7b419d8747a1feef81bbb3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:16.477005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.477927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:16.484576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 898/1797] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:16 2022] PUT /identity/v3/projects/02ac79c6bf8944f6b36b9b1b7a02e56f/users/063305dcc23849dab426bc30242a32c4/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:16.486078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb03a-e26f-4d12-8522-a63b652446e1 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.486667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb03a-e26f-4d12-8522-a63b652446e1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.486776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecb03a-e26f-4d12-8522-a63b652446e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.495062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:16.505620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d0dd-8f00-464a-9af9-ab8861b019c6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.509108 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-4eecb03a-e26f-4d12-8522-a63b652446e1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:16.510399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4eecb03a-e26f-4d12-8522-a63b652446e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:16.587705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b53e3-df1b-4c21-aabd-c4077be805de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.588510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b53e3-df1b-4c21-aabd-c4077be805de admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.588859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b53e3-df1b-4c21-aabd-c4077be805de admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.589209 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b53e3-df1b-4c21-aabd-c4077be805de admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.589942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b53e3-df1b-4c21-aabd-c4077be805de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.591809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b53e3-df1b-4c21-aabd-c4077be805de admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.592250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 899/1798] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:16.594119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26029f50-ce3e-4739-84ef-acd7f1320c75 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.594559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26029f50-ce3e-4739-84ef-acd7f1320c75 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.594991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26029f50-ce3e-4739-84ef-acd7f1320c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.613567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 900/1799] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:16.613567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576299-9a65-4840-a8a6-8232117f902c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.613567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576299-9a65-4840-a8a6-8232117f902c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.613567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576299-9a65-4840-a8a6-8232117f902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.633848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2e576299-9a65-4840-a8a6-8232117f902c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:16.635150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2e576299-9a65-4840-a8a6-8232117f902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:16.639602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-26029f50-ce3e-4739-84ef-acd7f1320c75 None None] MFA Rules not processed for user `063305dcc23849dab426bc30242a32c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:16.641057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-26029f50-ce3e-4739-84ef-acd7f1320c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:16.643741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 901/1800] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:16.647876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576299-9a65-4840-a8a6-8232117f902c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.658094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576299-9a65-4840-a8a6-8232117f902c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.663532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d634a-5a8c-477f-b680-e5c52152c6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.664435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d634a-5a8c-477f-b680-e5c52152c6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.664543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d634a-5a8c-477f-b680-e5c52152c6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.664822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d634a-5a8c-477f-b680-e5c52152c6ef admin admin] PATH_INFO: `/v3/projects/cebcbb63f65c40818a38dfa572cf8af8/users/cfea5b017f024d5a948ab246dce5bba1/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.683441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d634a-5a8c-477f-b680-e5c52152c6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebcbb63f65c40818a38dfa572cf8af8, user_id=cfea5b017f024d5a948ab246dce5bba1, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.687752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d634a-5a8c-477f-b680-e5c52152c6ef admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.732076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 900/1801] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:16.732975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26029f50-ce3e-4739-84ef-acd7f1320c75 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.746371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26029f50-ce3e-4739-84ef-acd7f1320c75 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.751788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.752544 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.752819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.753128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.753798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:16.754095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.755701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.767502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 901/1802] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:16.768521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.770488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:16.777635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 902/1803] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:16 2022] PUT /identity/v3/projects/cebcbb63f65c40818a38dfa572cf8af8/users/cfea5b017f024d5a948ab246dce5bba1/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:16.778602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d634a-5a8c-477f-b680-e5c52152c6ef admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.859796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e366f10-8bd5-49b5-9a5e-d379372da13d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.875795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d634a-5a8c-477f-b680-e5c52152c6ef admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:16.886230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bd44a-cb57-4afa-a7dc-89ac7e046c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.888234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd44a-cb57-4afa-a7dc-89ac7e046c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.888234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd44a-cb57-4afa-a7dc-89ac7e046c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.888234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd44a-cb57-4afa-a7dc-89ac7e046c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.888234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bd44a-cb57-4afa-a7dc-89ac7e046c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.889906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bd44a-cb57-4afa-a7dc-89ac7e046c29 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.910469 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c975928-d4bc-4c4c-9d03-1419594f1e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:16.911084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c975928-d4bc-4c4c-9d03-1419594f1e3e service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.911364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c975928-d4bc-4c4c-9d03-1419594f1e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.911635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c975928-d4bc-4c4c-9d03-1419594f1e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.915493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:16.950649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 903/1804] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:16 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:16.951990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b377d-f060-4007-bf29-6b2a1e4cd9f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:16.952545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b377d-f060-4007-bf29-6b2a1e4cd9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:16.952776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b377d-f060-4007-bf29-6b2a1e4cd9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:16.974943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c975928-d4bc-4c4c-9d03-1419594f1e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:16.976412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c975928-d4bc-4c4c-9d03-1419594f1e3e service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:16.982437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e17b377d-f060-4007-bf29-6b2a1e4cd9f4 None None] MFA Rules not processed for user `cfea5b017f024d5a948ab246dce5bba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:16.983653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e17b377d-f060-4007-bf29-6b2a1e4cd9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:16.986610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 902/1805] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:16.987382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c975928-d4bc-4c4c-9d03-1419594f1e3e service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:16.998191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c975928-d4bc-4c4c-9d03-1419594f1e3e service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.053348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 904/1806] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:17.054193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b377d-f060-4007-bf29-6b2a1e4cd9f4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.055508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e17b377d-f060-4007-bf29-6b2a1e4cd9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:17.061041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c2ca-442d-42ea-8428-4ca60b7bb8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.061666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c2ca-442d-42ea-8428-4ca60b7bb8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.062339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c2ca-442d-42ea-8428-4ca60b7bb8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.062566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c2ca-442d-42ea-8428-4ca60b7bb8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.063225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c2ca-442d-42ea-8428-4ca60b7bb8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.065175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c2ca-442d-42ea-8428-4ca60b7bb8f0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.111195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b377d-f060-4007-bf29-6b2a1e4cd9f4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.114734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.115340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.115616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.115884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.117603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:17.174516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.175936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.177478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 903/1807] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:16 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:17.178288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c2ca-442d-42ea-8428-4ca60b7bb8f0 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.186089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 905/1808] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:17.186973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.189810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c2ca-442d-42ea-8428-4ca60b7bb8f0 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.194762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a08bd-b4da-4e38-bbb6-a1781413664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.195398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a08bd-b4da-4e38-bbb6-a1781413664c admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.196042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a08bd-b4da-4e38-bbb6-a1781413664c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.196042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a08bd-b4da-4e38-bbb6-a1781413664c admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.196613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a08bd-b4da-4e38-bbb6-a1781413664c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.198549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a08bd-b4da-4e38-bbb6-a1781413664c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.199741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c96cdc-1fd1-4207-96e6-b6dd167bbe57 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.207197 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36ed78-999e-4b40-a523-406168f33de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.207766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36ed78-999e-4b40-a523-406168f33de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.208047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36ed78-999e-4b40-a523-406168f33de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.208334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36ed78-999e-4b40-a523-406168f33de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.209001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36ed78-999e-4b40-a523-406168f33de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.210637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36ed78-999e-4b40-a523-406168f33de6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.228109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 906/1809] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:17.229478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36ed78-999e-4b40-a523-406168f33de6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.242943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36ed78-999e-4b40-a523-406168f33de6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.249055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14154913-093e-4cca-9074-5f3b30f3fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.249686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154913-093e-4cca-9074-5f3b30f3fc6a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.249969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154913-093e-4cca-9074-5f3b30f3fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.250244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154913-093e-4cca-9074-5f3b30f3fc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.250904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14154913-093e-4cca-9074-5f3b30f3fc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.252546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14154913-093e-4cca-9074-5f3b30f3fc6a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.263823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 907/1810] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:17.268485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14154913-093e-4cca-9074-5f3b30f3fc6a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.279947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14154913-093e-4cca-9074-5f3b30f3fc6a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.280781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 904/1811] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:17 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:17.284810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a08bd-b4da-4e38-bbb6-a1781413664c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.365219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4078-7dc9-4258-b6bd-d88a9376a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.365642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a08bd-b4da-4e38-bbb6-a1781413664c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.366323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4078-7dc9-4258-b6bd-d88a9376a893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.366768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4078-7dc9-4258-b6bd-d88a9376a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.367212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a4078-7dc9-4258-b6bd-d88a9376a893 admin admin] PATH_INFO: `/v3/projects/c2958f697ce94cfa82df2eb6fec7ebf1/users/7073f23499f5431b8d8d6d477f3abe3d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.374327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0913-a4f0-4c9c-be67-68e7c70171ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.375037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0913-a4f0-4c9c-be67-68e7c70171ed admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.375325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0913-a4f0-4c9c-be67-68e7c70171ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.375600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f0913-a4f0-4c9c-be67-68e7c70171ed admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.376245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f0913-a4f0-4c9c-be67-68e7c70171ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.379077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f0913-a4f0-4c9c-be67-68e7c70171ed admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.390977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a4078-7dc9-4258-b6bd-d88a9376a893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2958f697ce94cfa82df2eb6fec7ebf1, user_id=7073f23499f5431b8d8d6d477f3abe3d, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.394542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a4078-7dc9-4258-b6bd-d88a9376a893 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.469582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 905/1812] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:17 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:17.475116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0913-a4f0-4c9c-be67-68e7c70171ed admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.485225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f0913-a4f0-4c9c-be67-68e7c70171ed admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.489764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa53a2-5868-44ab-bf17-6a66b1898e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.490343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa53a2-5868-44ab-bf17-6a66b1898e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.490622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa53a2-5868-44ab-bf17-6a66b1898e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.490937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa53a2-5868-44ab-bf17-6a66b1898e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.492929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa53a2-5868-44ab-bf17-6a66b1898e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.494927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa53a2-5868-44ab-bf17-6a66b1898e6a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.499210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 908/1813] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:17 2022] PUT /identity/v3/projects/c2958f697ce94cfa82df2eb6fec7ebf1/users/7073f23499f5431b8d8d6d477f3abe3d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:17.510222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 906/1814] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:17.510383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4078-7dc9-4258-b6bd-d88a9376a893 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.512286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb848eee-0f51-4f0b-a95e-6e67320457bc None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.512640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb848eee-0f51-4f0b-a95e-6e67320457bc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.512938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb848eee-0f51-4f0b-a95e-6e67320457bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.540719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-eb848eee-0f51-4f0b-a95e-6e67320457bc None None] MFA Rules not processed for user `7073f23499f5431b8d8d6d477f3abe3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:17.542026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-eb848eee-0f51-4f0b-a95e-6e67320457bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:17.572173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a4078-7dc9-4258-b6bd-d88a9376a893 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.577005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e31f4-1089-48cb-892b-08f6566e4d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.577675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e31f4-1089-48cb-892b-08f6566e4d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.579843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:17.580370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e31f4-1089-48cb-892b-08f6566e4d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.580799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e31f4-1089-48cb-892b-08f6566e4d55 admin admin] PATH_INFO: `/v3/projects/6e11ed9357cf4de682ed2ab7d5918e9b/users/c7078a35dd8946c0b949d5c594f5e1aa/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.596425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e31f4-1089-48cb-892b-08f6566e4d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e11ed9357cf4de682ed2ab7d5918e9b, user_id=c7078a35dd8946c0b949d5c594f5e1aa, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.599078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e31f4-1089-48cb-892b-08f6566e4d55 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.608219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 907/1815] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:17.619973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb848eee-0f51-4f0b-a95e-6e67320457bc None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.630551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb848eee-0f51-4f0b-a95e-6e67320457bc None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.635884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91feb3-db7a-4fcf-afed-117de8930769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.636424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91feb3-db7a-4fcf-afed-117de8930769 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.636707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91feb3-db7a-4fcf-afed-117de8930769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.636977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91feb3-db7a-4fcf-afed-117de8930769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.638238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91feb3-db7a-4fcf-afed-117de8930769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.640247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91feb3-db7a-4fcf-afed-117de8930769 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.670300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 909/1816] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:17 2022] PUT /identity/v3/projects/6e11ed9357cf4de682ed2ab7d5918e9b/users/c7078a35dd8946c0b949d5c594f5e1aa/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:17.676801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e31f4-1089-48cb-892b-08f6566e4d55 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.738411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 908/1817] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:17 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:17.739293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91feb3-db7a-4fcf-afed-117de8930769 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.739646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e31f4-1089-48cb-892b-08f6566e4d55 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.810577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91feb3-db7a-4fcf-afed-117de8930769 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.815636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cf5cf-70b0-456e-bdb1-86dddb79fad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.817618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cf5cf-70b0-456e-bdb1-86dddb79fad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.817618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cf5cf-70b0-456e-bdb1-86dddb79fad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.818398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cf5cf-70b0-456e-bdb1-86dddb79fad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.819041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cf5cf-70b0-456e-bdb1-86dddb79fad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.821803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cf5cf-70b0-456e-bdb1-86dddb79fad2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.823339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ff979-b940-4fe2-8ef3-fd855ad0dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.824073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff979-b940-4fe2-8ef3-fd855ad0dd0e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.824547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff979-b940-4fe2-8ef3-fd855ad0dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.825972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ff979-b940-4fe2-8ef3-fd855ad0dd0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.826743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ff979-b940-4fe2-8ef3-fd855ad0dd0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.828562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ff979-b940-4fe2-8ef3-fd855ad0dd0e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.840348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 910/1818] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:17.845339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ff979-b940-4fe2-8ef3-fd855ad0dd0e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.856420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ff979-b940-4fe2-8ef3-fd855ad0dd0e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:17.860406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f61dca-bdde-40f5-9a09-074f689ade61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:17.861120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61dca-bdde-40f5-9a09-074f689ade61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.862064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61dca-bdde-40f5-9a09-074f689ade61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.862064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61dca-bdde-40f5-9a09-074f689ade61 admin admin] PATH_INFO: `/v3/projects/6e11ed9357cf4de682ed2ab7d5918e9b/users/c7078a35dd8946c0b949d5c594f5e1aa/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.863896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f61dca-bdde-40f5-9a09-074f689ade61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e11ed9357cf4de682ed2ab7d5918e9b, user_id=c7078a35dd8946c0b949d5c594f5e1aa, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:17.866863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f61dca-bdde-40f5-9a09-074f689ade61 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:17.878723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 911/1819] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:17 2022] PUT /identity/v3/projects/6e11ed9357cf4de682ed2ab7d5918e9b/users/c7078a35dd8946c0b949d5c594f5e1aa/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:17.889980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290864-021a-4bf3-981c-00d42d72f7b5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:17.890284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290864-021a-4bf3-981c-00d42d72f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:17.890541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290864-021a-4bf3-981c-00d42d72f7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:17.919288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3c290864-021a-4bf3-981c-00d42d72f7b5 None None] MFA Rules not processed for user `c7078a35dd8946c0b949d5c594f5e1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:17.920814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3c290864-021a-4bf3-981c-00d42d72f7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:17.944197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 909/1820] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:17 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:17.953211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cf5cf-70b0-456e-bdb1-86dddb79fad2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:17.987312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cf5cf-70b0-456e-bdb1-86dddb79fad2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:18.013944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 912/1821] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:18.038782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290864-021a-4bf3-981c-00d42d72f7b5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:18.068447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48616-752f-4029-8e8e-2b0902b9f610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:18.069075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48616-752f-4029-8e8e-2b0902b9f610 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:18.069345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48616-752f-4029-8e8e-2b0902b9f610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:18.069615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48616-752f-4029-8e8e-2b0902b9f610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:18.070262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf48616-752f-4029-8e8e-2b0902b9f610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:18.071850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf48616-752f-4029-8e8e-2b0902b9f610 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:18.082103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 910/1822] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:18.086237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48616-752f-4029-8e8e-2b0902b9f610 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:18.096011 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48616-752f-4029-8e8e-2b0902b9f610 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:18.100910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd40a9-6256-4a34-ae0e-859b28d526fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:18.101561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd40a9-6256-4a34-ae0e-859b28d526fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:18.109960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd40a9-6256-4a34-ae0e-859b28d526fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:18.109960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd40a9-6256-4a34-ae0e-859b28d526fe admin admin] PATH_INFO: `/v3/projects/ad8911767f53402994451e3f5e8fc266/users/47429225c1cb4d2a913686ef0715c8f5/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:18.110163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290864-021a-4bf3-981c-00d42d72f7b5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:18.110163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ab050-9db7-4bac-b964-69260a86102a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:18.110163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ab050-9db7-4bac-b964-69260a86102a service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:18.110163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ab050-9db7-4bac-b964-69260a86102a service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:18.110491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ab050-9db7-4bac-b964-69260a86102a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:18.117733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd40a9-6256-4a34-ae0e-859b28d526fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8911767f53402994451e3f5e8fc266, user_id=47429225c1cb4d2a913686ef0715c8f5, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:18.119263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ab050-9db7-4bac-b964-69260a86102a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:18.120722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ab050-9db7-4bac-b964-69260a86102a service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:18.120841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd40a9-6256-4a34-ae0e-859b28d526fe admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:18.131502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 913/1823] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:18.211985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 911/1824] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:18 2022] PUT /identity/v3/projects/ad8911767f53402994451e3f5e8fc266/users/47429225c1cb4d2a913686ef0715c8f5/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:18.216019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ab050-9db7-4bac-b964-69260a86102a service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:18.226425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ab050-9db7-4bac-b964-69260a86102a service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:18.292008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051d72b-5c57-4a11-9ddb-bf3d865b9571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:18.292663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d72b-5c57-4a11-9ddb-bf3d865b9571 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:18.292996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d72b-5c57-4a11-9ddb-bf3d865b9571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:18.293271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d72b-5c57-4a11-9ddb-bf3d865b9571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:18.294506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051d72b-5c57-4a11-9ddb-bf3d865b9571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:18.296086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051d72b-5c57-4a11-9ddb-bf3d865b9571 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:18.305800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 914/1825] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:18.310670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd40a9-6256-4a34-ae0e-859b28d526fe admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:18.320770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd40a9-6256-4a34-ae0e-859b28d526fe admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:18.325226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7913c-fb0a-4e66-ade5-53bd5e177769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:18.325865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7913c-fb0a-4e66-ade5-53bd5e177769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:18.328389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7913c-fb0a-4e66-ade5-53bd5e177769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:18.328389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7913c-fb0a-4e66-ade5-53bd5e177769 admin admin] PATH_INFO: `/v3/projects/ad8911767f53402994451e3f5e8fc266/users/47429225c1cb4d2a913686ef0715c8f5/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:18.328389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7913c-fb0a-4e66-ade5-53bd5e177769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8911767f53402994451e3f5e8fc266, user_id=47429225c1cb4d2a913686ef0715c8f5, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:18.330853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7913c-fb0a-4e66-ade5-53bd5e177769 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:18.341147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 912/1826] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:18 2022] PUT /identity/v3/projects/ad8911767f53402994451e3f5e8fc266/users/47429225c1cb4d2a913686ef0715c8f5/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:18.351184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b6fa6-aefa-4d8a-9f57-f02ad9d6ac35 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:18.351475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b6fa6-aefa-4d8a-9f57-f02ad9d6ac35 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:18.351753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b6fa6-aefa-4d8a-9f57-f02ad9d6ac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:18.379648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e81b6fa6-aefa-4d8a-9f57-f02ad9d6ac35 None None] MFA Rules not processed for user `47429225c1cb4d2a913686ef0715c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:18.385732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e81b6fa6-aefa-4d8a-9f57-f02ad9d6ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:18.400896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:18.452979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 915/1827] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:18.493060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7913c-fb0a-4e66-ade5-53bd5e177769 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:18.567859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7913c-fb0a-4e66-ade5-53bd5e177769 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:18.574455 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1a78c-c9e0-429e-b54d-34925e1fec2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:18.575138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1a78c-c9e0-429e-b54d-34925e1fec2c service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:18.575385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1a78c-c9e0-429e-b54d-34925e1fec2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:18.575654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1a78c-c9e0-429e-b54d-34925e1fec2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:18.650078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1a78c-c9e0-429e-b54d-34925e1fec2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:18.652196 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1a78c-c9e0-429e-b54d-34925e1fec2c service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:18.658497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:18.672808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 913/1828] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:19.779308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:20.260035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:20.909895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:21.903926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:21.983993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:22.230152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b6fa6-aefa-4d8a-9f57-f02ad9d6ac35 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:22.242915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b6fa6-aefa-4d8a-9f57-f02ad9d6ac35 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:22.247663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ef2b-2796-4d6d-b36c-ab32aaa2ad24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:22.249117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ef2b-2796-4d6d-b36c-ab32aaa2ad24 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:22.249518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ef2b-2796-4d6d-b36c-ab32aaa2ad24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:22.250024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ef2b-2796-4d6d-b36c-ab32aaa2ad24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:22.274780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328ef2b-2796-4d6d-b36c-ab32aaa2ad24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:22.276239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328ef2b-2796-4d6d-b36c-ab32aaa2ad24 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:22.288440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 916/1829] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:22.326953 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:22.515990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:22.788197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650c4c-bd73-4896-98a9-1f97695cb4dc None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:22.788740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650c4c-bd73-4896-98a9-1f97695cb4dc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:22.789192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650c4c-bd73-4896-98a9-1f97695cb4dc None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:22.790702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 914/1830] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:23:22.805902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286887ca-665f-4156-b109-f3683ea970d7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:22.806256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286887ca-665f-4156-b109-f3683ea970d7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:22.806519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286887ca-665f-4156-b109-f3683ea970d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:22.841079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-286887ca-665f-4156-b109-f3683ea970d7 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:22.842582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-286887ca-665f-4156-b109-f3683ea970d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:22.913847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 917/1831] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:23:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:22.940056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650c4c-bd73-4896-98a9-1f97695cb4dc None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:22.947568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-92650c4c-bd73-4896-98a9-1f97695cb4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:22.964827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650c4c-bd73-4896-98a9-1f97695cb4dc None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:22.972047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:22.972702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:22.972981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:22.973251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:22.982500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:22.984070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:22.994369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 915/1832] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:23.156872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:23.186306 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286887ca-665f-4156-b109-f3683ea970d7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:23.269227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286887ca-665f-4156-b109-f3683ea970d7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:23.270775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:23.272475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:23.273313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:23.296534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:23.296534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:23.296534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] PATH_INFO: `/v3/users/cfea5b017f024d5a948ab246dce5bba1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:23.296534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfea5b017f024d5a948ab246dce5bba1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:23.296534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:23.297739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dcfdc-1e4c-4ce1-9951-bb89a6b637a9 service nova] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:23.297739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:23.297739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:23.297739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:23.298368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] PATH_INFO: `/v3/users/186209a0a74a4449a2467438f097871e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:23.298368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186209a0a74a4449a2467438f097871e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:23.298368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:23.556676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:23.557953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfea5b017f024d5a948ab246dce5bba1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.558652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfea5b017f024d5a948ab246dce5bba1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.584847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186209a0a74a4449a2467438f097871e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.623796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfea5b017f024d5a948ab246dce5bba1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.631457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfea5b017f024d5a948ab246dce5bba1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.645144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-97ee9492-e236-4eda-943d-81bb440d85a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfea5b017f024d5a948ab246dce5bba1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.651421 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 918/1833] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:23 2022] DELETE /identity/v3/users/cfea5b017f024d5a948ab246dce5bba1 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:23.656103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2f3a-ede6-4c83-90a3-412d344ac062 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:23.656490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2f3a-ede6-4c83-90a3-412d344ac062 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:23.656833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2f3a-ede6-4c83-90a3-412d344ac062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:23.675384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-247a2f3a-ede6-4c83-90a3-412d344ac062 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:23.676606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-247a2f3a-ede6-4c83-90a3-412d344ac062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:23.721076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186209a0a74a4449a2467438f097871e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.722263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186209a0a74a4449a2467438f097871e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.737098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186209a0a74a4449a2467438f097871e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.738158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1e2c3da0-1383-42b8-8cb0-2064ac5ad225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186209a0a74a4449a2467438f097871e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:23.748490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 919/1834] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:23.758163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a2f3a-ede6-4c83-90a3-412d344ac062 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:23.760535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-247a2f3a-ede6-4c83-90a3-412d344ac062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:23.765411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 916/1835] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:23 2022] DELETE /identity/v3/users/186209a0a74a4449a2467438f097871e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:23.769805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce418b34-4076-49be-9702-5d78d0e5e4e5 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:23.770334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce418b34-4076-49be-9702-5d78d0e5e4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:23.770334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce418b34-4076-49be-9702-5d78d0e5e4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:23.798254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ce418b34-4076-49be-9702-5d78d0e5e4e5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:23.800605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ce418b34-4076-49be-9702-5d78d0e5e4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:23.860610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a2f3a-ede6-4c83-90a3-412d344ac062 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:23.864506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 917/1836] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:23.876233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce418b34-4076-49be-9702-5d78d0e5e4e5 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:23.960527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce418b34-4076-49be-9702-5d78d0e5e4e5 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:23.961836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:23.964440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:23.964559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:23.965493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:23.965493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:23.965638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:23.965638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:23.965638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:23.973666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:23.974936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:23.976668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:23.978406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:23.986040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 918/1837] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:23.991744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 920/1838] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:24.470267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:24.561886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:24.563785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:24.576270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99ccb3-f7b2-4aae-a4ce-8530c7a44c51 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:24.581296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:24.581938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:24.582218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:24.582492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] PATH_INFO: `/v3/projects/671cbf1337444f589bdf831d99d1eaf4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:24.583614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671cbf1337444f589bdf831d99d1eaf4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:24.585540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:24.650282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:24.651726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:24.678349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7455e80-3daa-4969-ba4f-ecfb4d5aa371 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:24.690937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671cbf1337444f589bdf831d99d1eaf4', 'request_id': 'req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:24.697531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671cbf1337444f589bdf831d99d1eaf4', 'request_id': 'req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:24.706882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671cbf1337444f589bdf831d99d1eaf4', 'request_id': 'req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:24.727066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:24.759190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:24.759836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:24.760451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:24.760876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] PATH_INFO: `/v3/projects/cebcbb63f65c40818a38dfa572cf8af8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:24.762929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebcbb63f65c40818a38dfa572cf8af8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:24.765058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:24.778470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] The token cache is being invalidate because project 671cbf1337444f589bdf831d99d1eaf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:24.778710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:24.779731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:24.783628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 919/1839] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:24 2022] DELETE /identity/v3/projects/671cbf1337444f589bdf831d99d1eaf4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:24.787473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:24.788899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:24.805992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1ff0-8d9d-4ba0-b4a5-d84447ad90a6 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:24.811140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:24.811778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:24.812345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:24.812689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] PATH_INFO: `/v3/users/063305dcc23849dab426bc30242a32c4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:24.817188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] RBAC: Authorizing `identity:delete_user(user_id=063305dcc23849dab426bc30242a32c4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:24.819855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:24.899227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebcbb63f65c40818a38dfa572cf8af8', 'request_id': 'req-1e2b768d-af09-4b07-9738-53df154ccfc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:24.905624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebcbb63f65c40818a38dfa572cf8af8', 'request_id': 'req-1e2b768d-af09-4b07-9738-53df154ccfc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:24.912285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebcbb63f65c40818a38dfa572cf8af8', 'request_id': 'req-1e2b768d-af09-4b07-9738-53df154ccfc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.047772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] The token cache is being invalidate because project cebcbb63f65c40818a38dfa572cf8af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:25.048416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.049967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.052272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 921/1840] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:24 2022] DELETE /identity/v3/projects/cebcbb63f65c40818a38dfa572cf8af8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:25.056033 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:25.058936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:25.070169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063305dcc23849dab426bc30242a32c4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.132347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b768d-af09-4b07-9738-53df154ccfc9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:25.137964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:25.138694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:25.138982 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:25.139257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] PATH_INFO: `/v3/users/c7078a35dd8946c0b949d5c594f5e1aa` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:25.140441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7078a35dd8946c0b949d5c594f5e1aa)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:25.142561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:25.149393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063305dcc23849dab426bc30242a32c4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.150008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063305dcc23849dab426bc30242a32c4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.165931 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063305dcc23849dab426bc30242a32c4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.166740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063305dcc23849dab426bc30242a32c4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.181582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 920/1841] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:24 2022] DELETE /identity/v3/users/063305dcc23849dab426bc30242a32c4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:25.359782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7078a35dd8946c0b949d5c594f5e1aa'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.361469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7078a35dd8946c0b949d5c594f5e1aa'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.451811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7078a35dd8946c0b949d5c594f5e1aa'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.455669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:25.461165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7078a35dd8946c0b949d5c594f5e1aa'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.475576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7078a35dd8946c0b949d5c594f5e1aa'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:25.485567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 922/1842] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:25 2022] DELETE /identity/v3/users/c7078a35dd8946c0b949d5c594f5e1aa => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:25.743737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:25.745130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:25.906424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138326e-26f8-4210-b259-9fb13a1c149a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:25.987589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:25.988401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:25.988628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:25.988899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] PATH_INFO: `/v3/projects/02ac79c6bf8944f6b36b9b1b7a02e56f` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:25.990140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ac79c6bf8944f6b36b9b1b7a02e56f)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:25.992145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.112919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.115790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:26.132635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984906-4dd8-4fa5-bc7d-be767beed9e2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.138983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ac79c6bf8944f6b36b9b1b7a02e56f', 'request_id': 'req-d5626c29-e683-4ed5-8955-f8528935dd88'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.160780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ac79c6bf8944f6b36b9b1b7a02e56f', 'request_id': 'req-d5626c29-e683-4ed5-8955-f8528935dd88'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.176614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ac79c6bf8944f6b36b9b1b7a02e56f', 'request_id': 'req-d5626c29-e683-4ed5-8955-f8528935dd88'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.218249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.219073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.219415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.219758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] PATH_INFO: `/v3/projects/6e11ed9357cf4de682ed2ab7d5918e9b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.221145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e11ed9357cf4de682ed2ab7d5918e9b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.223092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.294062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] The token cache is being invalidate because project 02ac79c6bf8944f6b36b9b1b7a02e56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:26.294621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.295366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d5626c29-e683-4ed5-8955-f8528935dd88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.300153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 921/1843] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:25 2022] DELETE /identity/v3/projects/02ac79c6bf8944f6b36b9b1b7a02e56f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:26.302022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2102-d9ff-405e-a395-314c9a230df0 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.302315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2102-d9ff-405e-a395-314c9a230df0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.302588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2102-d9ff-405e-a395-314c9a230df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.326098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-94ba2102-d9ff-405e-a395-314c9a230df0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:26.327312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-94ba2102-d9ff-405e-a395-314c9a230df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:26.335129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 922/1844] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:26.343777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465590f8-fe00-440e-84d3-bab93b803bcf None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.343940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465590f8-fe00-440e-84d3-bab93b803bcf None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.344172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465590f8-fe00-440e-84d3-bab93b803bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.363651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-465590f8-fe00-440e-84d3-bab93b803bcf None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:26.364914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-465590f8-fe00-440e-84d3-bab93b803bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:26.367367 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e11ed9357cf4de682ed2ab7d5918e9b', 'request_id': 'req-f998e2b1-eee1-4362-a139-c4c73930f2f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.373380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e11ed9357cf4de682ed2ab7d5918e9b', 'request_id': 'req-f998e2b1-eee1-4362-a139-c4c73930f2f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.380006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e11ed9357cf4de682ed2ab7d5918e9b', 'request_id': 'req-f998e2b1-eee1-4362-a139-c4c73930f2f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.428101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 923/1845] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:26.433921 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465590f8-fe00-440e-84d3-bab93b803bcf None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.442756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465590f8-fe00-440e-84d3-bab93b803bcf None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.447333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.447923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.448202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.448504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.449697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:26.450266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.451593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.459263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] The token cache is being invalidate because project 6e11ed9357cf4de682ed2ab7d5918e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:26.464509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.464509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f998e2b1-eee1-4362-a139-c4c73930f2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:26.464509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 923/1846] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:26 2022] DELETE /identity/v3/projects/6e11ed9357cf4de682ed2ab7d5918e9b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:26.466501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 924/1847] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:23:26.468947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500623fa-0b58-45e0-8071-bdf6a41a1ecf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.469241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500623fa-0b58-45e0-8071-bdf6a41a1ecf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.469527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500623fa-0b58-45e0-8071-bdf6a41a1ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.470696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.472557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:26.475857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:26.489869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01f1c-380c-4a03-a9be-f66dfd467e50 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.491627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-500623fa-0b58-45e0-8071-bdf6a41a1ecf None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:26.492871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-500623fa-0b58-45e0-8071-bdf6a41a1ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:26.496140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e12d-7738-44bf-b282-79c49ccefa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.496852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e12d-7738-44bf-b282-79c49ccefa40 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.497138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e12d-7738-44bf-b282-79c49ccefa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.497413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e12d-7738-44bf-b282-79c49ccefa40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.498076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e12d-7738-44bf-b282-79c49ccefa40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.499966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e12d-7738-44bf-b282-79c49ccefa40 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.501403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 924/1848] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:26.509373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52d2a-9be7-4d5a-b4af-83f261158b66 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.509656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52d2a-9be7-4d5a-b4af-83f261158b66 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.509926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52d2a-9be7-4d5a-b4af-83f261158b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.530560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-50a52d2a-9be7-4d5a-b4af-83f261158b66 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:26.531752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-50a52d2a-9be7-4d5a-b4af-83f261158b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:26.540367 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 925/1849] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:26.544780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a52d2a-9be7-4d5a-b4af-83f261158b66 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.553832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a52d2a-9be7-4d5a-b4af-83f261158b66 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.558714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.559326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.559600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.559870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.560552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:26.562556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.562556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.574712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 925/1850] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:26 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:26.577650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 926/1851] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:23:26.579273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e12d-7738-44bf-b282-79c49ccefa40 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.582034 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.595358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bef938-c480-4713-9ad1-9eaa3f1f46fc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.653859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b3d8b-c0ce-467a-83df-8ff604abef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.654593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3d8b-c0ce-467a-83df-8ff604abef15 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.655023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3d8b-c0ce-467a-83df-8ff604abef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.655303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3d8b-c0ce-467a-83df-8ff604abef15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.655927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b3d8b-c0ce-467a-83df-8ff604abef15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.657357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e12d-7738-44bf-b282-79c49ccefa40 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.657832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b3d8b-c0ce-467a-83df-8ff604abef15 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.662262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0995dc-542f-4f88-91d8-125b229baf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.662865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0995dc-542f-4f88-91d8-125b229baf9c admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.663145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0995dc-542f-4f88-91d8-125b229baf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.663418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0995dc-542f-4f88-91d8-125b229baf9c admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.664050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0995dc-542f-4f88-91d8-125b229baf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.666131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0995dc-542f-4f88-91d8-125b229baf9c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.779674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 927/1852] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:26 2022] POST /identity/v3/projects => generated 407 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:26.783566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b3d8b-c0ce-467a-83df-8ff604abef15 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.850917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b3d8b-c0ce-467a-83df-8ff604abef15 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.853652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 926/1853] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:26 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:26.856474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fcfad-5e04-41de-89d5-fca65d36a8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.857093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fcfad-5e04-41de-89d5-fca65d36a8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.857378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fcfad-5e04-41de-89d5-fca65d36a8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.857654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fcfad-5e04-41de-89d5-fca65d36a8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.858282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fcfad-5e04-41de-89d5-fca65d36a8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.858799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0995dc-542f-4f88-91d8-125b229baf9c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.860248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fcfad-5e04-41de-89d5-fca65d36a8e2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.868434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0995dc-542f-4f88-91d8-125b229baf9c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.873280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1e11-cb1d-4b3f-9c5a-e8c1eefb5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.873878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1e11-cb1d-4b3f-9c5a-e8c1eefb5015 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.874155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1e11-cb1d-4b3f-9c5a-e8c1eefb5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.875271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1e11-cb1d-4b3f-9c5a-e8c1eefb5015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.875271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae1e11-cb1d-4b3f-9c5a-e8c1eefb5015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.876684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae1e11-cb1d-4b3f-9c5a-e8c1eefb5015 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.886550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 927/1854] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:26.890269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1e11-cb1d-4b3f-9c5a-e8c1eefb5015 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.899595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1e11-cb1d-4b3f-9c5a-e8c1eefb5015 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.904842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd164e8-3eb9-4a6c-ad6a-bacbd7ac5a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.905419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd164e8-3eb9-4a6c-ad6a-bacbd7ac5a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.905701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd164e8-3eb9-4a6c-ad6a-bacbd7ac5a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.905972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd164e8-3eb9-4a6c-ad6a-bacbd7ac5a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.906595 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd164e8-3eb9-4a6c-ad6a-bacbd7ac5a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.908249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd164e8-3eb9-4a6c-ad6a-bacbd7ac5a49 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.919125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 928/1855] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:26.922984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd164e8-3eb9-4a6c-ad6a-bacbd7ac5a49 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.932052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd164e8-3eb9-4a6c-ad6a-bacbd7ac5a49 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:26.937068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6e629-4844-42cb-bd85-b789cb5bca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:26.937704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6e629-4844-42cb-bd85-b789cb5bca02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:26.937992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6e629-4844-42cb-bd85-b789cb5bca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:26.938267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6e629-4844-42cb-bd85-b789cb5bca02 admin admin] PATH_INFO: `/v3/projects/852f8755f8cd4d0ab0ed1213440f63c1/users/badf51d0b0f646ddada871057a6feb2d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:26.953020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6e629-4844-42cb-bd85-b789cb5bca02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852f8755f8cd4d0ab0ed1213440f63c1, user_id=badf51d0b0f646ddada871057a6feb2d, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:26.956637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6e629-4844-42cb-bd85-b789cb5bca02 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:26.984457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 928/1856] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:26 2022] POST /identity/v3/users => generated 304 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:26.985482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fcfad-5e04-41de-89d5-fca65d36a8e2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:26.995301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fcfad-5e04-41de-89d5-fca65d36a8e2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:27.000503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae5bb-6a01-46f8-842d-0810a8cda638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:27.001101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae5bb-6a01-46f8-842d-0810a8cda638 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.001381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae5bb-6a01-46f8-842d-0810a8cda638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.001652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae5bb-6a01-46f8-842d-0810a8cda638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.002305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae5bb-6a01-46f8-842d-0810a8cda638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:27.003882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae5bb-6a01-46f8-842d-0810a8cda638 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:27.014836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 929/1857] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:27.019311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae5bb-6a01-46f8-842d-0810a8cda638 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:27.023392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 929/1858] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:26 2022] PUT /identity/v3/projects/852f8755f8cd4d0ab0ed1213440f63c1/users/badf51d0b0f646ddada871057a6feb2d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:27.030230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae5bb-6a01-46f8-842d-0810a8cda638 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:27.036666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2097926-9f16-448c-be0e-0ab10b274030 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.037028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2097926-9f16-448c-be0e-0ab10b274030 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.037372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2097926-9f16-448c-be0e-0ab10b274030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.066737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c2097926-9f16-448c-be0e-0ab10b274030 None None] MFA Rules not processed for user `badf51d0b0f646ddada871057a6feb2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:27.067942 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c2097926-9f16-448c-be0e-0ab10b274030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:27.093085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a608e-a0ff-4095-ba2e-5a256344b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:27.093777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a608e-a0ff-4095-ba2e-5a256344b32f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.094071 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a608e-a0ff-4095-ba2e-5a256344b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.094350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a608e-a0ff-4095-ba2e-5a256344b32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.095411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a608e-a0ff-4095-ba2e-5a256344b32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:27.097654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a608e-a0ff-4095-ba2e-5a256344b32f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:27.113360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 930/1859] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:27.114823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a608e-a0ff-4095-ba2e-5a256344b32f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:27.127283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a608e-a0ff-4095-ba2e-5a256344b32f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:27.132827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa467c-3a96-4ec7-a6d8-c3202d2cc94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:27.133557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa467c-3a96-4ec7-a6d8-c3202d2cc94f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.133843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa467c-3a96-4ec7-a6d8-c3202d2cc94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.134126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa467c-3a96-4ec7-a6d8-c3202d2cc94f admin admin] PATH_INFO: `/v3/projects/4bcdd0f26a2547f68bcf746a10fea6e1/users/ffb3e68851ad43ba93d88fa4708dd953/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.148630 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 930/1860] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:27.157897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa467c-3a96-4ec7-a6d8-c3202d2cc94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcdd0f26a2547f68bcf746a10fea6e1, user_id=ffb3e68851ad43ba93d88fa4708dd953, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:27.161100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa467c-3a96-4ec7-a6d8-c3202d2cc94f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:27.161522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2097926-9f16-448c-be0e-0ab10b274030 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:27.162984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c2097926-9f16-448c-be0e-0ab10b274030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:27.264063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 931/1861] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:27 2022] PUT /identity/v3/projects/4bcdd0f26a2547f68bcf746a10fea6e1/users/ffb3e68851ad43ba93d88fa4708dd953/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:27.282405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43e6a4-e18c-4766-8278-18238c220235 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.282616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2097926-9f16-448c-be0e-0ab10b274030 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:27.282702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43e6a4-e18c-4766-8278-18238c220235 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.282956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43e6a4-e18c-4766-8278-18238c220235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.326912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3b43e6a4-e18c-4766-8278-18238c220235 None None] MFA Rules not processed for user `ffb3e68851ad43ba93d88fa4708dd953`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:27.328895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3b43e6a4-e18c-4766-8278-18238c220235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:27.412955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:27.421864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc7327f524a450e8429b5008166e5d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:27.422728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.423101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.423526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.488532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 932/1862] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:27 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:27.493231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43e6a4-e18c-4766-8278-18238c220235 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:27.556074 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:27.557951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:27.570114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 931/1863] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:27.617499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:27.622057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:27.651043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43e6a4-e18c-4766-8278-18238c220235 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:27.665670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcf71c-443d-4f06-91b3-9576c7730bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:27.666257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcf71c-443d-4f06-91b3-9576c7730bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.666595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcf71c-443d-4f06-91b3-9576c7730bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.667010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcf71c-443d-4f06-91b3-9576c7730bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.667638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcf71c-443d-4f06-91b3-9576c7730bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:27.670569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcf71c-443d-4f06-91b3-9576c7730bf4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:27.680761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae26e5-1c0f-49bc-a0f7-f99ef68d341e service glance] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:27.697168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:27.697817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.698100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.698368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] PATH_INFO: `/v3/users/cf8e97880404478b9ebaae2a03ab2428` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.711072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8e97880404478b9ebaae2a03ab2428)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:27.713094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:27.750707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 933/1864] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:27 2022] POST /identity/v3/projects => generated 409 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:27.750707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcf71c-443d-4f06-91b3-9576c7730bf4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:27.858865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcf71c-443d-4f06-91b3-9576c7730bf4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:27.865158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0812a3-654f-4cba-8b66-1c6a4c37cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:27.865939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0812a3-654f-4cba-8b66-1c6a4c37cfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:27.866398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0812a3-654f-4cba-8b66-1c6a4c37cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:27.866716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0812a3-654f-4cba-8b66-1c6a4c37cfb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:27.878688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0812a3-654f-4cba-8b66-1c6a4c37cfb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:27.878688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0812a3-654f-4cba-8b66-1c6a4c37cfb9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:28.015635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8e97880404478b9ebaae2a03ab2428'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:28.024947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 934/1865] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:27 2022] POST /identity/v3/users => generated 311 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:28.029856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0812a3-654f-4cba-8b66-1c6a4c37cfb9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:28.040184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0812a3-654f-4cba-8b66-1c6a4c37cfb9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:28.045675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82df2e6-cb2c-4937-80c4-c4ae6f38a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:28.045983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df2e6-cb2c-4937-80c4-c4ae6f38a67b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:28.046368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df2e6-cb2c-4937-80c4-c4ae6f38a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:28.046683 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df2e6-cb2c-4937-80c4-c4ae6f38a67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:28.047504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82df2e6-cb2c-4937-80c4-c4ae6f38a67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:28.049115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82df2e6-cb2c-4937-80c4-c4ae6f38a67b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:28.067162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 935/1866] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:28.077363 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82df2e6-cb2c-4937-80c4-c4ae6f38a67b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:28.088514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82df2e6-cb2c-4937-80c4-c4ae6f38a67b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:28.098637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:28.099598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:28.100114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:28.103972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] PATH_INFO: `/v3/projects/034de54e8d36430f879864ddbcfa6011/users/b3ba0789cf54457ba63751e72073f881/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:28.121701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8e97880404478b9ebaae2a03ab2428'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:28.121843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=034de54e8d36430f879864ddbcfa6011, user_id=b3ba0789cf54457ba63751e72073f881, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:28.122940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8e97880404478b9ebaae2a03ab2428'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:28.125300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:28.147370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8e97880404478b9ebaae2a03ab2428'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:28.148587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29f3a12b-f75e-47aa-a30a-9b7b613d9873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8e97880404478b9ebaae2a03ab2428'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:28.164928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 932/1867] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:27 2022] DELETE /identity/v3/users/cf8e97880404478b9ebaae2a03ab2428 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:28.170225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cbd06-a620-42f3-9ca8-3887bf9c4c7a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:28.170508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cbd06-a620-42f3-9ca8-3887bf9c4c7a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:28.170901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cbd06-a620-42f3-9ca8-3887bf9c4c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:28.191044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-fa0cbd06-a620-42f3-9ca8-3887bf9c4c7a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:28.192244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fa0cbd06-a620-42f3-9ca8-3887bf9c4c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:28.211338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 936/1868] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:28 2022] PUT /identity/v3/projects/034de54e8d36430f879864ddbcfa6011/users/b3ba0789cf54457ba63751e72073f881/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:28.212541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:28.215580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:28.264227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 933/1869] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:28.274645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cbd06-a620-42f3-9ca8-3887bf9c4c7a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:28.276072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fa0cbd06-a620-42f3-9ca8-3887bf9c4c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:28.286662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52471f9a-7e52-4c3e-80c1-852f08d0a864 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:28.288185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:28.291978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ce16b-51c9-442c-a1d9-b5f840b87422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:28.292814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce16b-51c9-442c-a1d9-b5f840b87422 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:28.293690 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce16b-51c9-442c-a1d9-b5f840b87422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:28.297972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce16b-51c9-442c-a1d9-b5f840b87422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:28.297972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ce16b-51c9-442c-a1d9-b5f840b87422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:28.297972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ce16b-51c9-442c-a1d9-b5f840b87422 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:28.306681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 937/1870] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:28.312088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ce16b-51c9-442c-a1d9-b5f840b87422 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:28.323442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ce16b-51c9-442c-a1d9-b5f840b87422 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:28.334782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87191003-bb5f-4ed4-9993-ea922de0af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:28.335434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191003-bb5f-4ed4-9993-ea922de0af9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:28.335721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191003-bb5f-4ed4-9993-ea922de0af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:28.335999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191003-bb5f-4ed4-9993-ea922de0af9d admin admin] PATH_INFO: `/v3/projects/034de54e8d36430f879864ddbcfa6011/users/b3ba0789cf54457ba63751e72073f881/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:28.338397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87191003-bb5f-4ed4-9993-ea922de0af9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=034de54e8d36430f879864ddbcfa6011, user_id=b3ba0789cf54457ba63751e72073f881, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:28.342278 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87191003-bb5f-4ed4-9993-ea922de0af9d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:28.353547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cbd06-a620-42f3-9ca8-3887bf9c4c7a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:28.354774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 938/1871] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:28 2022] PUT /identity/v3/projects/034de54e8d36430f879864ddbcfa6011/users/b3ba0789cf54457ba63751e72073f881/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:28.374735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52c6df-9b0a-45c9-ac28-effbeca3b3f6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:28.375425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52c6df-9b0a-45c9-ac28-effbeca3b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:28.375425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52c6df-9b0a-45c9-ac28-effbeca3b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:28.419004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0c52c6df-9b0a-45c9-ac28-effbeca3b3f6 None None] MFA Rules not processed for user `b3ba0789cf54457ba63751e72073f881`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:28.421695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0c52c6df-9b0a-45c9-ac28-effbeca3b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:28.429914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:28.430540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:28.430818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:28.431081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:28.525959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:28.528067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:28.539235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 934/1872] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:28.559752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 939/1873] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:28 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:28.570457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:28.571857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:28.657307 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce326b8-fc9d-4ddd-80d8-caffedb05919 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:28.689874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:28.691733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:28.693288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:28.695334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:28.716474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:28.718364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:28.731671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 935/1874] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:29.043531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52c6df-9b0a-45c9-ac28-effbeca3b3f6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:29.046201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0c52c6df-9b0a-45c9-ac28-effbeca3b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:29.065881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52c6df-9b0a-45c9-ac28-effbeca3b3f6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:29.083608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:29.084420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:29.084888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:29.086080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] PATH_INFO: `/v3/projects/824ae6855e7a48b4b4d7ce198f4ebd0d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:29.087678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=824ae6855e7a48b4b4d7ce198f4ebd0d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:29.093284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:29.098099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:29.119894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:29.121973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:29.137570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e64d-42fc-43c5-8818-ca9b4761b0b4 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:29.141637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:29.142252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:29.142599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:29.142866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:29.145562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:29.235636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:29.238000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:29.262870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 936/1875] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:29.320171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824ae6855e7a48b4b4d7ce198f4ebd0d', 'request_id': 'req-81492729-e265-48a1-9fb7-d225ace4fa6d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.327335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824ae6855e7a48b4b4d7ce198f4ebd0d', 'request_id': 'req-81492729-e265-48a1-9fb7-d225ace4fa6d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.335502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824ae6855e7a48b4b4d7ce198f4ebd0d', 'request_id': 'req-81492729-e265-48a1-9fb7-d225ace4fa6d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.458609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] The token cache is being invalidate because project 824ae6855e7a48b4b4d7ce198f4ebd0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:29.460522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.460522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.461761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 940/1876] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:29 2022] DELETE /identity/v3/projects/824ae6855e7a48b4b4d7ce198f4ebd0d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:29.466311 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:29.477391 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9516e-c2c0-49ab-81df-4812aee8a431 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:29.557722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:29.558463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:29.558764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:29.559034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] PATH_INFO: `/v3/users/c59a13e274c449b0bfb3c8992f12bed8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:29.560161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59a13e274c449b0bfb3c8992f12bed8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:29.562360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:29.737542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:29.837444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59a13e274c449b0bfb3c8992f12bed8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.937291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59a13e274c449b0bfb3c8992f12bed8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.938065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59a13e274c449b0bfb3c8992f12bed8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.954460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59a13e274c449b0bfb3c8992f12bed8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.958232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4b87b136-b782-4fe7-b822-d4111a1be42a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59a13e274c449b0bfb3c8992f12bed8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:29.972781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 937/1877] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:29 2022] DELETE /identity/v3/users/c59a13e274c449b0bfb3c8992f12bed8 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:30.552335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:30.554943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:30.556479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:30.571030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81492729-e265-48a1-9fb7-d225ace4fa6d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:30.635624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:30.650045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:30.650800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:30.650947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:30.651305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] PATH_INFO: `/v3/projects/83dc00d049354ec385ec8ed667425ef6` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:30.652743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dc00d049354ec385ec8ed667425ef6)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:30.654950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:30.846795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dc00d049354ec385ec8ed667425ef6', 'request_id': 'req-88b25222-1dc8-406e-abda-dffa1c4439ed'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:30.856156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dc00d049354ec385ec8ed667425ef6', 'request_id': 'req-88b25222-1dc8-406e-abda-dffa1c4439ed'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:30.870361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dc00d049354ec385ec8ed667425ef6', 'request_id': 'req-88b25222-1dc8-406e-abda-dffa1c4439ed'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:30.977881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] The token cache is being invalidate because project 83dc00d049354ec385ec8ed667425ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:30.978190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:30.979048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88b25222-1dc8-406e-abda-dffa1c4439ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:30.981351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 941/1878] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:30 2022] DELETE /identity/v3/projects/83dc00d049354ec385ec8ed667425ef6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:30.986840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2de21-4078-4f55-99b7-998de079d2f2 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:30.987137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2de21-4078-4f55-99b7-998de079d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:30.987620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2de21-4078-4f55-99b7-998de079d2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.009352 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ddd2de21-4078-4f55-99b7-998de079d2f2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:31.010620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ddd2de21-4078-4f55-99b7-998de079d2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:31.084896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 938/1879] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:31.093909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242ff9-014b-4912-a063-8fa8282b4240 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:31.094471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242ff9-014b-4912-a063-8fa8282b4240 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:31.094811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242ff9-014b-4912-a063-8fa8282b4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.118778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b4242ff9-014b-4912-a063-8fa8282b4240 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:31.119995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b4242ff9-014b-4912-a063-8fa8282b4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:31.128760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 942/1880] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:31.132948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2de21-4078-4f55-99b7-998de079d2f2 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:31.143938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2de21-4078-4f55-99b7-998de079d2f2 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:31.148802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:31.149408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:31.149695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:31.149965 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.151014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:31.151014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:31.153419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:31.178153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:31.185464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 939/1881] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:31.192361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242ff9-014b-4912-a063-8fa8282b4240 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:31.206714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242ff9-014b-4912-a063-8fa8282b4240 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:31.233081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12bf8e-63d3-4b08-885e-997ec0078e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:31.235027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12bf8e-63d3-4b08-885e-997ec0078e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:31.235495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12bf8e-63d3-4b08-885e-997ec0078e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:31.235821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12bf8e-63d3-4b08-885e-997ec0078e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.236510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12bf8e-63d3-4b08-885e-997ec0078e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:31.238624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12bf8e-63d3-4b08-885e-997ec0078e45 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:31.366667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 943/1882] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:31 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:31.371004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:31.381001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76a970-1afa-4a9b-96d5-55565146949e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:31.476205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2a33-5742-4338-8fc1-5e4b200ecd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:31.476893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2a33-5742-4338-8fc1-5e4b200ecd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:31.477338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2a33-5742-4338-8fc1-5e4b200ecd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:31.477619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a2a33-5742-4338-8fc1-5e4b200ecd2d admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.480956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2a33-5742-4338-8fc1-5e4b200ecd2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:31.480956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a2a33-5742-4338-8fc1-5e4b200ecd2d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:31.589548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 940/1883] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:31 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:31.594813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12bf8e-63d3-4b08-885e-997ec0078e45 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:31.606823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12bf8e-63d3-4b08-885e-997ec0078e45 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:31.614768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325ef6-fecb-4079-a0e0-8f3abeed0268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:31.615597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325ef6-fecb-4079-a0e0-8f3abeed0268 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:31.615875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325ef6-fecb-4079-a0e0-8f3abeed0268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:31.621256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c325ef6-fecb-4079-a0e0-8f3abeed0268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.621256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c325ef6-fecb-4079-a0e0-8f3abeed0268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:31.621256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c325ef6-fecb-4079-a0e0-8f3abeed0268 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:31.630184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 944/1884] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:31.634585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2a33-5742-4338-8fc1-5e4b200ecd2d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:31.648857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a2a33-5742-4338-8fc1-5e4b200ecd2d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:31.653551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8719b8-d80f-46e7-a4fe-3bd65756de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:31.654566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8719b8-d80f-46e7-a4fe-3bd65756de46 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:31.654566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8719b8-d80f-46e7-a4fe-3bd65756de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:31.654852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8719b8-d80f-46e7-a4fe-3bd65756de46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.655584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8719b8-d80f-46e7-a4fe-3bd65756de46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:31.657392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8719b8-d80f-46e7-a4fe-3bd65756de46 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:31.671304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 941/1885] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:31.676663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325ef6-fecb-4079-a0e0-8f3abeed0268 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:31.689389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c325ef6-fecb-4079-a0e0-8f3abeed0268 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:31.696559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2a0d5-0646-46be-9d73-bc35abba98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:31.697923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2a0d5-0646-46be-9d73-bc35abba98e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:31.698617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2a0d5-0646-46be-9d73-bc35abba98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:31.699203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2a0d5-0646-46be-9d73-bc35abba98e7 admin admin] PATH_INFO: `/v3/projects/ba0becb1f6e342ad8593bc9c37551a2b/users/993e9d07eac94013abc1ae230c717793/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.722118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2a0d5-0646-46be-9d73-bc35abba98e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0becb1f6e342ad8593bc9c37551a2b, user_id=993e9d07eac94013abc1ae230c717793, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:31.724998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2a0d5-0646-46be-9d73-bc35abba98e7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:31.835680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 945/1886] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:31 2022] PUT /identity/v3/projects/ba0becb1f6e342ad8593bc9c37551a2b/users/993e9d07eac94013abc1ae230c717793/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:31.838409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d71f-78f4-4548-aad3-1ecba791b4f7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:31.839277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d71f-78f4-4548-aad3-1ecba791b4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:31.840870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d71f-78f4-4548-aad3-1ecba791b4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:31.882926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e450d71f-78f4-4548-aad3-1ecba791b4f7 None None] MFA Rules not processed for user `993e9d07eac94013abc1ae230c717793`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:31.882926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e450d71f-78f4-4548-aad3-1ecba791b4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:31.979335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 942/1887] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:31.981334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2a0d5-0646-46be-9d73-bc35abba98e7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:32.063947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2a0d5-0646-46be-9d73-bc35abba98e7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:32.068722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d291-f017-4193-bdf5-975b48258fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:32.069530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d291-f017-4193-bdf5-975b48258fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:32.069817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d291-f017-4193-bdf5-975b48258fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:32.070150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d291-f017-4193-bdf5-975b48258fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:32.070779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d291-f017-4193-bdf5-975b48258fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:32.074399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d291-f017-4193-bdf5-975b48258fbb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:32.121451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:32.199767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 946/1888] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:31 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:32.204152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450d71f-78f4-4548-aad3-1ecba791b4f7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:32.227740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450d71f-78f4-4548-aad3-1ecba791b4f7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:32.376157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33106eef-c002-4aa3-a8b8-3d248bb02359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:32.376909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33106eef-c002-4aa3-a8b8-3d248bb02359 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:32.377200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33106eef-c002-4aa3-a8b8-3d248bb02359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:32.377476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33106eef-c002-4aa3-a8b8-3d248bb02359 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:32.378171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33106eef-c002-4aa3-a8b8-3d248bb02359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:32.380157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33106eef-c002-4aa3-a8b8-3d248bb02359 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:32.550888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d291-f017-4193-bdf5-975b48258fbb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:32.551092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 943/1889] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:32 2022] POST /identity/v3/users => generated 295 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:32.574218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d291-f017-4193-bdf5-975b48258fbb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:32.603418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f897efc-e5fb-4ce4-a6ca-2b32749d49b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:32.606241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897efc-e5fb-4ce4-a6ca-2b32749d49b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:32.606891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897efc-e5fb-4ce4-a6ca-2b32749d49b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:32.607974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f897efc-e5fb-4ce4-a6ca-2b32749d49b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:32.608938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f897efc-e5fb-4ce4-a6ca-2b32749d49b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:32.627486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f897efc-e5fb-4ce4-a6ca-2b32749d49b3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:32.646102 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:32.646635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 947/1890] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:32.650686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33106eef-c002-4aa3-a8b8-3d248bb02359 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:32.665769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33106eef-c002-4aa3-a8b8-3d248bb02359 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:32.673094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d3f6c-f612-49c7-a325-b70124eb7539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:32.673948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3f6c-f612-49c7-a325-b70124eb7539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:32.674308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3f6c-f612-49c7-a325-b70124eb7539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:32.674665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3f6c-f612-49c7-a325-b70124eb7539 admin admin] PATH_INFO: `/v3/projects/4e8a72d42e1d4fb08a682d64f160ff98/users/dd25695e8c444d79b8933f7435c6971c/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:32.700205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d3f6c-f612-49c7-a325-b70124eb7539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8a72d42e1d4fb08a682d64f160ff98, user_id=dd25695e8c444d79b8933f7435c6971c, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:32.703182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d3f6c-f612-49c7-a325-b70124eb7539 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:32.791194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 944/1891] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:32 2022] PUT /identity/v3/projects/4e8a72d42e1d4fb08a682d64f160ff98/users/dd25695e8c444d79b8933f7435c6971c/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:32.795418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f897efc-e5fb-4ce4-a6ca-2b32749d49b3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:32.806357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f897efc-e5fb-4ce4-a6ca-2b32749d49b3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:32.909426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:32.928244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04956363-96be-4c21-82f7-a6e6f440777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:32.928797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956363-96be-4c21-82f7-a6e6f440777b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:32.929155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956363-96be-4c21-82f7-a6e6f440777b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:32.929593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04956363-96be-4c21-82f7-a6e6f440777b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:32.930324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04956363-96be-4c21-82f7-a6e6f440777b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:32.932244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04956363-96be-4c21-82f7-a6e6f440777b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:32.952364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 948/1892] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:32.954211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d3f6c-f612-49c7-a325-b70124eb7539 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:32.965628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d3f6c-f612-49c7-a325-b70124eb7539 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:32.971806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:32.973378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:32.973784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:32.974159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] PATH_INFO: `/v3/projects/4e8a72d42e1d4fb08a682d64f160ff98/users/dd25695e8c444d79b8933f7435c6971c/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:32.982780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8a72d42e1d4fb08a682d64f160ff98, user_id=dd25695e8c444d79b8933f7435c6971c, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:32.987263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:33.001673 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 945/1893] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:32 2022] PUT /identity/v3/projects/4e8a72d42e1d4fb08a682d64f160ff98/users/dd25695e8c444d79b8933f7435c6971c/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:33.005541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:33.015374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be579b-8807-45d3-b411-5b3fcb954e0e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:33.016192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be579b-8807-45d3-b411-5b3fcb954e0e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:33.016665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be579b-8807-45d3-b411-5b3fcb954e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:33.067713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-32be579b-8807-45d3-b411-5b3fcb954e0e None None] MFA Rules not processed for user `dd25695e8c444d79b8933f7435c6971c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:33.067713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-32be579b-8807-45d3-b411-5b3fcb954e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:33.187623 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 949/1894] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:33.205343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:33.207404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:33.275721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d5fb-20ca-4577-aca0-2a814eea2705 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:33.281779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:33.282678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:33.283136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:33.283990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:33.296944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:33.298591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:33.312731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 946/1895] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:33.355948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:33.564900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be579b-8807-45d3-b411-5b3fcb954e0e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:33.566342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-32be579b-8807-45d3-b411-5b3fcb954e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:33.581773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be579b-8807-45d3-b411-5b3fcb954e0e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:33.585632 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5807d-63cb-45af-9a53-09604b8e0478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:33.586397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5807d-63cb-45af-9a53-09604b8e0478 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:33.587120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5807d-63cb-45af-9a53-09604b8e0478 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:33.587120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5807d-63cb-45af-9a53-09604b8e0478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:33.652838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5807d-63cb-45af-9a53-09604b8e0478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:33.654989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5807d-63cb-45af-9a53-09604b8e0478 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:33.664785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 950/1896] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:33.760370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:34.269075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:38.444230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:38.445737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:38.511029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6fdaa-6f28-4fe2-87c8-534f0c629dcb service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:38.515537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:38.516179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:38.516492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:38.516764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] PATH_INFO: `/v3/users/ffb3e68851ad43ba93d88fa4708dd953` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:38.518866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb3e68851ad43ba93d88fa4708dd953)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:38.520070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:38.641727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb3e68851ad43ba93d88fa4708dd953'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:38.702027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb3e68851ad43ba93d88fa4708dd953'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:38.702747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb3e68851ad43ba93d88fa4708dd953'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:38.715704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb3e68851ad43ba93d88fa4708dd953'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:38.716357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb3e68851ad43ba93d88fa4708dd953'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:38.728008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 947/1897] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:38 2022] DELETE /identity/v3/users/ffb3e68851ad43ba93d88fa4708dd953 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:38.733237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a6a6-745b-48f0-9fe0-71ee747d5bcb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:38.733727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a6a6-745b-48f0-9fe0-71ee747d5bcb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:38.733822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a6a6-745b-48f0-9fe0-71ee747d5bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:38.752705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7920a6a6-745b-48f0-9fe0-71ee747d5bcb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:38.756268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7920a6a6-745b-48f0-9fe0-71ee747d5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:38.814179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 951/1898] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:38.831545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:38.831545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:38.845886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:38.906567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb94fc-de03-44a0-8cf1-ee49fa56c219 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:38.912695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d715a-feb7-43d8-9bda-c93ed15b30b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:38.913393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d715a-feb7-43d8-9bda-c93ed15b30b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:38.913734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d715a-feb7-43d8-9bda-c93ed15b30b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:38.914075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d715a-feb7-43d8-9bda-c93ed15b30b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:38.924722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d715a-feb7-43d8-9bda-c93ed15b30b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:38.926223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d715a-feb7-43d8-9bda-c93ed15b30b9 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:38.937100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 948/1899] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:39.434006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920a6a6-745b-48f0-9fe0-71ee747d5bcb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:39.437041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7920a6a6-745b-48f0-9fe0-71ee747d5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:39.457538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920a6a6-745b-48f0-9fe0-71ee747d5bcb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:39.462548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:39.463225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:39.463508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:39.463730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] PATH_INFO: `/v3/projects/4bcdd0f26a2547f68bcf746a10fea6e1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:39.465107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcdd0f26a2547f68bcf746a10fea6e1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:39.467493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:39.474330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:39.576866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcdd0f26a2547f68bcf746a10fea6e1', 'request_id': 'req-44b3684a-cf09-4916-acc8-217bc856e960'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:39.582937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcdd0f26a2547f68bcf746a10fea6e1', 'request_id': 'req-44b3684a-cf09-4916-acc8-217bc856e960'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:39.590721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcdd0f26a2547f68bcf746a10fea6e1', 'request_id': 'req-44b3684a-cf09-4916-acc8-217bc856e960'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:39.690925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] The token cache is being invalidate because project 4bcdd0f26a2547f68bcf746a10fea6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:39.690925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:39.690925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:39.690925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 952/1900] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:39 2022] DELETE /identity/v3/projects/4bcdd0f26a2547f68bcf746a10fea6e1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:39.693249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d715a-feb7-43d8-9bda-c93ed15b30b9 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:39.704073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d715a-feb7-43d8-9bda-c93ed15b30b9 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:39.763912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:39.764601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:39.764898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:39.765324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] PATH_INFO: `/v3/users/b3ba0789cf54457ba63751e72073f881` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:39.766594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ba0789cf54457ba63751e72073f881)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:39.768942 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:39.932207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ba0789cf54457ba63751e72073f881'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:39.994205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ba0789cf54457ba63751e72073f881'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:39.995476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ba0789cf54457ba63751e72073f881'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:40.009272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ba0789cf54457ba63751e72073f881'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:40.010003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ba0789cf54457ba63751e72073f881'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:40.024335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 949/1901] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:39 2022] DELETE /identity/v3/users/b3ba0789cf54457ba63751e72073f881 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:40.561621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:40.563709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:40.579713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3684a-cf09-4916-acc8-217bc856e960 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:40.647357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:40.647929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:40.648463 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:40.648744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] PATH_INFO: `/v3/projects/034de54e8d36430f879864ddbcfa6011` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:40.650217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=034de54e8d36430f879864ddbcfa6011)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:40.652193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:40.732910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:40.734469 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:40.754983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b7097-a40c-41d4-b75f-ab2d11fd42eb admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:40.762728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034de54e8d36430f879864ddbcfa6011', 'request_id': 'req-a4bf4fab-d823-4aad-94bc-ab6a400ae069'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:40.769438 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034de54e8d36430f879864ddbcfa6011', 'request_id': 'req-a4bf4fab-d823-4aad-94bc-ab6a400ae069'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:40.776402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034de54e8d36430f879864ddbcfa6011', 'request_id': 'req-a4bf4fab-d823-4aad-94bc-ab6a400ae069'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:40.796215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:40.827108 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:40.828240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:40.828443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:40.828726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] PATH_INFO: `/v3/users/7073f23499f5431b8d8d6d477f3abe3d` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:40.829885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7073f23499f5431b8d8d6d477f3abe3d)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:40.835092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:40.909597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] The token cache is being invalidate because project 034de54e8d36430f879864ddbcfa6011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:40.909833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:40.910862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a4bf4fab-d823-4aad-94bc-ab6a400ae069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:40.913097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 953/1902] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:40 2022] DELETE /identity/v3/projects/034de54e8d36430f879864ddbcfa6011 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:40.918378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebfee-f3c7-4ca3-a201-f1460ba19a55 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:40.920108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebfee-f3c7-4ca3-a201-f1460ba19a55 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:40.920108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eebfee-f3c7-4ca3-a201-f1460ba19a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:40.944511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b4eebfee-f3c7-4ca3-a201-f1460ba19a55 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:40.946419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b4eebfee-f3c7-4ca3-a201-f1460ba19a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:40.960195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 954/1903] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:40.969287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492fbf-d9d9-43c9-92b5-d0a5fd978529 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:40.969597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492fbf-d9d9-43c9-92b5-d0a5fd978529 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:40.970028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492fbf-d9d9-43c9-92b5-d0a5fd978529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.007709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8e492fbf-d9d9-43c9-92b5-d0a5fd978529 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:41.007709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8e492fbf-d9d9-43c9-92b5-d0a5fd978529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:41.017232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 955/1904] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:41.023379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492fbf-d9d9-43c9-92b5-d0a5fd978529 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.035951 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492fbf-d9d9-43c9-92b5-d0a5fd978529 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.041266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.041871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.042152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.042452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.042594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7073f23499f5431b8d8d6d477f3abe3d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:41.043085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:41.043389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.045092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:41.054079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:41.061211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 956/1905] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:23:41.066778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.094237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c464b-b401-438b-a869-9c5b55da9ebf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.102225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.102860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.103138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.103412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.104058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.105987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:41.136085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7073f23499f5431b8d8d6d477f3abe3d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:41.136936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7073f23499f5431b8d8d6d477f3abe3d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:41.150348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7073f23499f5431b8d8d6d477f3abe3d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:41.151384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fb4a8ea-ef1b-497d-ad33-db61820c5aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7073f23499f5431b8d8d6d477f3abe3d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:41.166862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 950/1906] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:40 2022] DELETE /identity/v3/users/7073f23499f5431b8d8d6d477f3abe3d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:41.171166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f759-22ad-4cdf-b9e3-570c864e91ff None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.171450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f759-22ad-4cdf-b9e3-570c864e91ff None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.171719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210f759-22ad-4cdf-b9e3-570c864e91ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.191292 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d210f759-22ad-4cdf-b9e3-570c864e91ff None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:41.192533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d210f759-22ad-4cdf-b9e3-570c864e91ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:41.211054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 957/1907] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:41 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:41.215373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.217626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:41.272177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 951/1908] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:41.281261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210f759-22ad-4cdf-b9e3-570c864e91ff None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.282775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d210f759-22ad-4cdf-b9e3-570c864e91ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:41.295473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c63ed5-50f1-41cb-b307-88729acfbb6a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.300911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac357-a2c5-47bc-9df1-185b573a9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.301671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac357-a2c5-47bc-9df1-185b573a9cac admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.302026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac357-a2c5-47bc-9df1-185b573a9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.305155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac357-a2c5-47bc-9df1-185b573a9cac admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.305155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ac357-a2c5-47bc-9df1-185b573a9cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.305155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ac357-a2c5-47bc-9df1-185b573a9cac admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:41.350608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210f759-22ad-4cdf-b9e3-570c864e91ff None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.359786 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:41.390141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 958/1909] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:41 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:41.394187 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac357-a2c5-47bc-9df1-185b573a9cac admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.409731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac357-a2c5-47bc-9df1-185b573a9cac admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.415022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44427-b572-46b4-9875-eb4abb6c6f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.415919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44427-b572-46b4-9875-eb4abb6c6f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.416478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44427-b572-46b4-9875-eb4abb6c6f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.416932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44427-b572-46b4-9875-eb4abb6c6f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.417685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd44427-b572-46b4-9875-eb4abb6c6f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.423720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd44427-b572-46b4-9875-eb4abb6c6f53 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:41.428565 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c59b3-ac41-414f-a6b2-26efff2458d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.429788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c59b3-ac41-414f-a6b2-26efff2458d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.430318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c59b3-ac41-414f-a6b2-26efff2458d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.430915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c59b3-ac41-414f-a6b2-26efff2458d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.436535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 959/1910] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:41.442922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44427-b572-46b4-9875-eb4abb6c6f53 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.445832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c59b3-ac41-414f-a6b2-26efff2458d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.447748 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c59b3-ac41-414f-a6b2-26efff2458d5 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:41.463300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 952/1911] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:41.469432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44427-b572-46b4-9875-eb4abb6c6f53 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.474989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6014-d1b6-4287-af4c-bbb5f48d414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.476170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6014-d1b6-4287-af4c-bbb5f48d414c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.476697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6014-d1b6-4287-af4c-bbb5f48d414c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.477045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6014-d1b6-4287-af4c-bbb5f48d414c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.477915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc6014-d1b6-4287-af4c-bbb5f48d414c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.479824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc6014-d1b6-4287-af4c-bbb5f48d414c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:41.499135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 960/1912] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:41.503605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c59b3-ac41-414f-a6b2-26efff2458d5 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.519478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c59b3-ac41-414f-a6b2-26efff2458d5 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.525189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.525933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.526219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.526493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] PATH_INFO: `/v3/projects/c5b0eb39a67145bdac1dd84da14063f7/users/caa9a0f19532403cbc28d7ff2b0e0aeb/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.545696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b0eb39a67145bdac1dd84da14063f7, user_id=caa9a0f19532403cbc28d7ff2b0e0aeb, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.548494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:41.651529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 953/1913] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:41 2022] PUT /identity/v3/projects/c5b0eb39a67145bdac1dd84da14063f7/users/caa9a0f19532403cbc28d7ff2b0e0aeb/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:41.662704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14067-96fa-4bfe-a55b-37891b449191 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.663248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14067-96fa-4bfe-a55b-37891b449191 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.663248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14067-96fa-4bfe-a55b-37891b449191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.694196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bca14067-96fa-4bfe-a55b-37891b449191 None None] MFA Rules not processed for user `caa9a0f19532403cbc28d7ff2b0e0aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:41.695712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bca14067-96fa-4bfe-a55b-37891b449191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:41.770073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 961/1914] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:41.783293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.785109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:41.850546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722a82c-9845-4236-9a80-a89c1cab49b0 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.854208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.854875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.855307 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.855583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.865897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.870319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:41.878847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 954/1915] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:41.902823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca14067-96fa-4bfe-a55b-37891b449191 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:41.941319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:41.971862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca14067-96fa-4bfe-a55b-37891b449191 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:41.976292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:41.976995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:41.977339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:41.977612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] PATH_INFO: `/v3/users/caa9a0f19532403cbc28d7ff2b0e0aeb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:41.979785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa9a0f19532403cbc28d7ff2b0e0aeb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:41.981088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:42.083790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:42.085624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:42.122257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecbd04-d957-4c5b-8087-6cca7c934993 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:42.128713 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:42.129514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:42.129733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:42.130002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] PATH_INFO: `/v3/projects/c2958f697ce94cfa82df2eb6fec7ebf1` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:42.132172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2958f697ce94cfa82df2eb6fec7ebf1)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:42.134445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:42.146781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa9a0f19532403cbc28d7ff2b0e0aeb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.148149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa9a0f19532403cbc28d7ff2b0e0aeb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.250785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa9a0f19532403cbc28d7ff2b0e0aeb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.258514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa9a0f19532403cbc28d7ff2b0e0aeb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.272933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2958f697ce94cfa82df2eb6fec7ebf1', 'request_id': 'req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.273108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6fcab8e6-e1f3-418c-a48d-bb3a55fd650b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa9a0f19532403cbc28d7ff2b0e0aeb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.283973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2958f697ce94cfa82df2eb6fec7ebf1', 'request_id': 'req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.287029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 962/1916] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:41 2022] DELETE /identity/v3/users/caa9a0f19532403cbc28d7ff2b0e0aeb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:42.291411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c0c6-bacb-44e3-990b-874923f6a9c9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:42.291695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c0c6-bacb-44e3-990b-874923f6a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:42.291995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c0c6-bacb-44e3-990b-874923f6a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:42.293889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2958f697ce94cfa82df2eb6fec7ebf1', 'request_id': 'req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.311230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7826c0c6-bacb-44e3-990b-874923f6a9c9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:42.312464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7826c0c6-bacb-44e3-990b-874923f6a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:42.359728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] The token cache is being invalidate because project c2958f697ce94cfa82df2eb6fec7ebf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:42.360012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.360702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.365396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 955/1917] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:42 2022] DELETE /identity/v3/projects/c2958f697ce94cfa82df2eb6fec7ebf1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:42.369443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:42.370776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:42.371006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 963/1918] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:42.381188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c0c6-bacb-44e3-990b-874923f6a9c9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:42.382539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7826c0c6-bacb-44e3-990b-874923f6a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:42.406903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:42.447028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c0c6-bacb-44e3-990b-874923f6a9c9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:42.451420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:42.452032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:42.452318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:42.452643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:42.459745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:42.462695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:42.464208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:42.467674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171c44-1d7d-4a6c-8a2f-90aa0db950c2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:42.474782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 964/1919] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:42.483834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:42.488722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:42.489165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:42.492831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] PATH_INFO: `/v3/users/47429225c1cb4d2a913686ef0715c8f5` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:42.492831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47429225c1cb4d2a913686ef0715c8f5)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:42.493590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:42.708594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47429225c1cb4d2a913686ef0715c8f5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.788946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47429225c1cb4d2a913686ef0715c8f5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.789663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47429225c1cb4d2a913686ef0715c8f5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.802498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47429225c1cb4d2a913686ef0715c8f5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.803197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47429225c1cb4d2a913686ef0715c8f5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:42.825951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 956/1920] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:42 2022] DELETE /identity/v3/users/47429225c1cb4d2a913686ef0715c8f5 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:42.856180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:42.858377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:42.872934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f324-8b0e-44de-b833-20679ad893cd service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:42.932457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:42.933096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:42.933379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:42.933655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] PATH_INFO: `/v3/users/993e9d07eac94013abc1ae230c717793` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:42.935428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=993e9d07eac94013abc1ae230c717793)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:42.937591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:42.965476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:42.973339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:42.999005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbe1a-1681-4f42-b160-d2bf3ac22e19 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:43.008140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:43.009227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.009227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.009782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] PATH_INFO: `/v3/projects/c5b0eb39a67145bdac1dd84da14063f7` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.011044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b0eb39a67145bdac1dd84da14063f7)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:43.013356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:43.177528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993e9d07eac94013abc1ae230c717793'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.178464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993e9d07eac94013abc1ae230c717793'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.183359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b0eb39a67145bdac1dd84da14063f7', 'request_id': 'req-c86acade-a524-42e2-9fe4-5139cdddcdf1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.191989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b0eb39a67145bdac1dd84da14063f7', 'request_id': 'req-c86acade-a524-42e2-9fe4-5139cdddcdf1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.203202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b0eb39a67145bdac1dd84da14063f7', 'request_id': 'req-c86acade-a524-42e2-9fe4-5139cdddcdf1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.268874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993e9d07eac94013abc1ae230c717793'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.277109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993e9d07eac94013abc1ae230c717793'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.291205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cb909cc0-48e1-4d4d-97a9-d1dac0d22e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993e9d07eac94013abc1ae230c717793'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.298777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 965/1921] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:42 2022] DELETE /identity/v3/users/993e9d07eac94013abc1ae230c717793 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:43.303368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38a423-63ab-41d4-a922-da8a06288a52 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.303775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38a423-63ab-41d4-a922-da8a06288a52 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.304393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38a423-63ab-41d4-a922-da8a06288a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.326427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5f38a423-63ab-41d4-a922-da8a06288a52 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:43.327617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f38a423-63ab-41d4-a922-da8a06288a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:43.342857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] The token cache is being invalidate because project c5b0eb39a67145bdac1dd84da14063f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:43.343233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.343888 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c86acade-a524-42e2-9fe4-5139cdddcdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.345431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 957/1922] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:42 2022] DELETE /identity/v3/projects/c5b0eb39a67145bdac1dd84da14063f7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:43.349987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea31e-2f85-4e07-b478-419cbb0edd99 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.350264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea31e-2f85-4e07-b478-419cbb0edd99 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.350728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ea31e-2f85-4e07-b478-419cbb0edd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.373998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2f8ea31e-2f85-4e07-b478-419cbb0edd99 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:43.375199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2f8ea31e-2f85-4e07-b478-419cbb0edd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:43.386893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:43.394271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 966/1923] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:43.405270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38a423-63ab-41d4-a922-da8a06288a52 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:43.406661 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f38a423-63ab-41d4-a922-da8a06288a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:43.432220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:43.449209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 958/1924] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:43.449209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea31e-2f85-4e07-b478-419cbb0edd99 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:43.449209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2f8ea31e-2f85-4e07-b478-419cbb0edd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:43.459395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ea31e-2f85-4e07-b478-419cbb0edd99 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:43.464435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:43.465068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.465376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.465699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] PATH_INFO: `/v3/projects/ad8911767f53402994451e3f5e8fc266` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.467633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8911767f53402994451e3f5e8fc266)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:43.469599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:43.476165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38a423-63ab-41d4-a922-da8a06288a52 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:43.480078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3886c0-73b6-40b9-9597-708010edb08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:43.480724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3886c0-73b6-40b9-9597-708010edb08c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.481002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3886c0-73b6-40b9-9597-708010edb08c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.481270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3886c0-73b6-40b9-9597-708010edb08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.491921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3886c0-73b6-40b9-9597-708010edb08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:43.493485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3886c0-73b6-40b9-9597-708010edb08c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:43.503398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 967/1925] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:43.504634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d8a8-5a4f-47d1-995b-7e6feb7e1c73 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.504917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d8a8-5a4f-47d1-995b-7e6feb7e1c73 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.505188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d8a8-5a4f-47d1-995b-7e6feb7e1c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.526032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3062d8a8-5a4f-47d1-995b-7e6feb7e1c73 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:43.527236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3062d8a8-5a4f-47d1-995b-7e6feb7e1c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:43.536198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 968/1926] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:43.540075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d8a8-5a4f-47d1-995b-7e6feb7e1c73 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:43.555262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d8a8-5a4f-47d1-995b-7e6feb7e1c73 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:43.556829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:43.557593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.558188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.558188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.558984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:43.559351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:43.561096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:43.574993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 969/1927] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:23:43.582194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:43.595283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c64e2-7eaa-494e-a1dc-8166c87bc502 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:43.616400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8911767f53402994451e3f5e8fc266', 'request_id': 'req-acf8c722-929f-4bb4-af4b-ad316d5a5384'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.624409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8911767f53402994451e3f5e8fc266', 'request_id': 'req-acf8c722-929f-4bb4-af4b-ad316d5a5384'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.631222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8911767f53402994451e3f5e8fc266', 'request_id': 'req-acf8c722-929f-4bb4-af4b-ad316d5a5384'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.665621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:43.666428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.666715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.666990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.667665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:43.669977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:43.731699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] The token cache is being invalidate because project ad8911767f53402994451e3f5e8fc266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:43.732085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.732782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-acf8c722-929f-4bb4-af4b-ad316d5a5384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:43.748408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 959/1928] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:43 2022] DELETE /identity/v3/projects/ad8911767f53402994451e3f5e8fc266 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:43.750165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764efe2-78ba-403a-90b0-24717b4d23d1 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.750520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764efe2-78ba-403a-90b0-24717b4d23d1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.750804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764efe2-78ba-403a-90b0-24717b4d23d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.766553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 970/1929] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:43 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:43.770861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:43.779656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:43.787575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-b764efe2-78ba-403a-90b0-24717b4d23d1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:43.789187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b764efe2-78ba-403a-90b0-24717b4d23d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:43.882236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e285dc-199a-42a4-bd3a-b97ed187d56a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:43.891142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:43.891785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.892070 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.892381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.893319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:43.895799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:43.910476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 960/1930] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:43.920270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1431e-51ad-4fa2-9a15-deeffbc3934f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.920661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1431e-51ad-4fa2-9a15-deeffbc3934f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.924525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1431e-51ad-4fa2-9a15-deeffbc3934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.941032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-0af1431e-51ad-4fa2-9a15-deeffbc3934f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:43.942236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0af1431e-51ad-4fa2-9a15-deeffbc3934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:43.951467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 961/1931] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:43.955917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1431e-51ad-4fa2-9a15-deeffbc3934f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:43.965181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1431e-51ad-4fa2-9a15-deeffbc3934f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:43.969873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:43.970499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:43.970807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:43.971079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:43.971724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:43.972043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:43.973684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:43.985985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 962/1932] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:23:43.990447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.000823 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22e42a-3a88-4592-9c44-6ae95162654b admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.005757 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a857d8f-24b2-4b4e-8aa6-37e8ccc68ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.006349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857d8f-24b2-4b4e-8aa6-37e8ccc68ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.006627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857d8f-24b2-4b4e-8aa6-37e8ccc68ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.007119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a857d8f-24b2-4b4e-8aa6-37e8ccc68ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.007872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a857d8f-24b2-4b4e-8aa6-37e8ccc68ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.009934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a857d8f-24b2-4b4e-8aa6-37e8ccc68ed7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.027267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 971/1933] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:43 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:44.028249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.033767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:44.046804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4fb7d-5d4d-4793-9422-fb03e3a2713b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.051877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.053245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.053532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.053806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] PATH_INFO: `/v3/projects/ba0becb1f6e342ad8593bc9c37551a2b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.055259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0becb1f6e342ad8593bc9c37551a2b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.057318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.070661 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:44.081815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:44.088790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 963/1934] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:43 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:44.089805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a857d8f-24b2-4b4e-8aa6-37e8ccc68ed7 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.150744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0becb1f6e342ad8593bc9c37551a2b', 'request_id': 'req-df35cce8-a7dc-4775-a006-8009da940740'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.156887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0becb1f6e342ad8593bc9c37551a2b', 'request_id': 'req-df35cce8-a7dc-4775-a006-8009da940740'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.158404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a857d8f-24b2-4b4e-8aa6-37e8ccc68ed7 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.163593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0becb1f6e342ad8593bc9c37551a2b', 'request_id': 'req-df35cce8-a7dc-4775-a006-8009da940740'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.214424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15895e43-8a89-4cc0-baa7-29e8b41f2deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.215014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15895e43-8a89-4cc0-baa7-29e8b41f2deb admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.215295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15895e43-8a89-4cc0-baa7-29e8b41f2deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.215568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15895e43-8a89-4cc0-baa7-29e8b41f2deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.217047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15895e43-8a89-4cc0-baa7-29e8b41f2deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.218644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15895e43-8a89-4cc0-baa7-29e8b41f2deb admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.228366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 964/1935] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:44.229151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15895e43-8a89-4cc0-baa7-29e8b41f2deb admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.238607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15895e43-8a89-4cc0-baa7-29e8b41f2deb admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.243635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0904-53d1-4c78-b0b9-ada41ac07463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.244243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0904-53d1-4c78-b0b9-ada41ac07463 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.244565 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0904-53d1-4c78-b0b9-ada41ac07463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.244857 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f0904-53d1-4c78-b0b9-ada41ac07463 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.245464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f0904-53d1-4c78-b0b9-ada41ac07463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.247375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f0904-53d1-4c78-b0b9-ada41ac07463 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.250117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] The token cache is being invalidate because project ba0becb1f6e342ad8593bc9c37551a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:44.250708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.251430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.253450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 972/1936] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:44 2022] DELETE /identity/v3/projects/ba0becb1f6e342ad8593bc9c37551a2b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:44.257447 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.259750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:44.274744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cce8-a7dc-4775-a006-8009da940740 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.280240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.280996 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.281333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.281608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.282319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.283950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.294275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 973/1937] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:44.295159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.296786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:44.308894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6892067-e0ff-4e4e-9601-819d4885085f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.314561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.315211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.315489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.315759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] PATH_INFO: `/v3/users/dd25695e8c444d79b8933f7435c6971c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.316936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd25695e8c444d79b8933f7435c6971c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.322257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.348851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 965/1938] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:44 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:44.349970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0904-53d1-4c78-b0b9-ada41ac07463 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.359583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f0904-53d1-4c78-b0b9-ada41ac07463 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.365309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.365951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.366228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.366498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] PATH_INFO: `/v3/projects/d603604ef0564035abb3a805a2650eab/users/2fcc5fdb677c4eb9addd184280cafd74/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.381966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d603604ef0564035abb3a805a2650eab, user_id=2fcc5fdb677c4eb9addd184280cafd74, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.384840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.457806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 966/1939] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:44 2022] PUT /identity/v3/projects/d603604ef0564035abb3a805a2650eab/users/2fcc5fdb677c4eb9addd184280cafd74/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:44.458636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.460208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:44.525328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3c4ff-a0c1-4aac-8735-1885d379b400 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.530090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd25695e8c444d79b8933f7435c6971c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.530737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd25695e8c444d79b8933f7435c6971c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.531695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5e47c-08b3-4c63-9fe9-427e3fde5a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.532523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5e47c-08b3-4c63-9fe9-427e3fde5a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.532909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5e47c-08b3-4c63-9fe9-427e3fde5a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.533284 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5e47c-08b3-4c63-9fe9-427e3fde5a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.533993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5e47c-08b3-4c63-9fe9-427e3fde5a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.535620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5e47c-08b3-4c63-9fe9-427e3fde5a94 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.546113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 967/1940] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:44.547347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c776-7ef0-4165-91ba-989f12d21175 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.547636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c776-7ef0-4165-91ba-989f12d21175 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.547909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c776-7ef0-4165-91ba-989f12d21175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.576020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-7754c776-7ef0-4165-91ba-989f12d21175 None None] MFA Rules not processed for user `2fcc5fdb677c4eb9addd184280cafd74`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:44.577378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7754c776-7ef0-4165-91ba-989f12d21175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:44.598593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd25695e8c444d79b8933f7435c6971c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.606275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd25695e8c444d79b8933f7435c6971c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.618907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd25695e8c444d79b8933f7435c6971c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:44.625975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 974/1941] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:44 2022] DELETE /identity/v3/users/dd25695e8c444d79b8933f7435c6971c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:44.627085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.628492 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:44.649422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 968/1942] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:44.664128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754c776-7ef0-4165-91ba-989f12d21175 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.666104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7754c776-7ef0-4165-91ba-989f12d21175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:44.674702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:44.709756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:44.713917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e0757-edd0-42ed-ba0a-9c29b9361339 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.719495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022df1-1079-4557-9fda-b892a5942f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.720155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022df1-1079-4557-9fda-b892a5942f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.720714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022df1-1079-4557-9fda-b892a5942f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.720884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022df1-1079-4557-9fda-b892a5942f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.721551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf022df1-1079-4557-9fda-b892a5942f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.724067 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf022df1-1079-4557-9fda-b892a5942f2d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.731551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754c776-7ef0-4165-91ba-989f12d21175 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.736332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 975/1943] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:44.738719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022df1-1079-4557-9fda-b892a5942f2d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:44.749252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022df1-1079-4557-9fda-b892a5942f2d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:44.754833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3da61c-79ed-4dca-ad4f-8b9d82e2f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.755489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3da61c-79ed-4dca-ad4f-8b9d82e2f3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.755773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3da61c-79ed-4dca-ad4f-8b9d82e2f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.756053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3da61c-79ed-4dca-ad4f-8b9d82e2f3e0 admin admin] PATH_INFO: `/v3/projects/bf5caecde09a47fcb70a5e633ff1cb3c/users/816d7a40c3ce42b1aea0b004cee5f02e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.773292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3da61c-79ed-4dca-ad4f-8b9d82e2f3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5caecde09a47fcb70a5e633ff1cb3c, user_id=816d7a40c3ce42b1aea0b004cee5f02e, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.780691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3da61c-79ed-4dca-ad4f-8b9d82e2f3e0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.785476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a317e4c-a403-4b82-a06f-e18dca570376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:44.786113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a317e4c-a403-4b82-a06f-e18dca570376 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.786385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a317e4c-a403-4b82-a06f-e18dca570376 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.786654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a317e4c-a403-4b82-a06f-e18dca570376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.852072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a317e4c-a403-4b82-a06f-e18dca570376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:44.853587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a317e4c-a403-4b82-a06f-e18dca570376 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:44.870140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 976/1944] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:44 2022] PUT /identity/v3/projects/bf5caecde09a47fcb70a5e633ff1cb3c/users/816d7a40c3ce42b1aea0b004cee5f02e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:44.880969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 969/1945] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:44.882216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485f05-ffae-41eb-9ae0-30a9b2dad055 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:44.882503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485f05-ffae-41eb-9ae0-30a9b2dad055 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:44.883041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485f05-ffae-41eb-9ae0-30a9b2dad055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:44.914507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-77485f05-ffae-41eb-9ae0-30a9b2dad055 None None] MFA Rules not processed for user `816d7a40c3ce42b1aea0b004cee5f02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:44.916299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-77485f05-ffae-41eb-9ae0-30a9b2dad055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:45.001392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 977/1946] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:45.005976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a317e4c-a403-4b82-a06f-e18dca570376 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.018839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a317e4c-a403-4b82-a06f-e18dca570376 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.030557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:45.083466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec9369-6a25-47e2-be55-62a1696eeb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.084089 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9369-6a25-47e2-be55-62a1696eeb4c admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.084404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9369-6a25-47e2-be55-62a1696eeb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.084684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9369-6a25-47e2-be55-62a1696eeb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.085318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec9369-6a25-47e2-be55-62a1696eeb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.086856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77485f05-ffae-41eb-9ae0-30a9b2dad055 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.087483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec9369-6a25-47e2-be55-62a1696eeb4c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.088361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-77485f05-ffae-41eb-9ae0-30a9b2dad055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:45.103440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77485f05-ffae-41eb-9ae0-30a9b2dad055 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.109012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.109744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.110049 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.110323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] PATH_INFO: `/v3/projects/4e8a72d42e1d4fb08a682d64f160ff98` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.111469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8a72d42e1d4fb08a682d64f160ff98)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.113488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.168355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 970/1947] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:45.172290 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec9369-6a25-47e2-be55-62a1696eeb4c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.209514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8a72d42e1d4fb08a682d64f160ff98', 'request_id': 'req-d9db3716-2f25-4a76-97e0-83c4c849864f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:45.225844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8a72d42e1d4fb08a682d64f160ff98', 'request_id': 'req-d9db3716-2f25-4a76-97e0-83c4c849864f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:45.235249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8a72d42e1d4fb08a682d64f160ff98', 'request_id': 'req-d9db3716-2f25-4a76-97e0-83c4c849864f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:45.255078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec9369-6a25-47e2-be55-62a1696eeb4c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.314221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.315182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.315393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.315732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.316668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.319414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.382148 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] The token cache is being invalidate because project 4e8a72d42e1d4fb08a682d64f160ff98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:45.382512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:45.383234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9db3716-2f25-4a76-97e0-83c4c849864f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:45.385081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 978/1948] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:45 2022] DELETE /identity/v3/projects/4e8a72d42e1d4fb08a682d64f160ff98 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:45.389779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a364c0-6365-4e6e-91f8-839e978ae5af None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.390062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a364c0-6365-4e6e-91f8-839e978ae5af None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.390335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a364c0-6365-4e6e-91f8-839e978ae5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.411478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e4a364c0-6365-4e6e-91f8-839e978ae5af None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:45.412712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e4a364c0-6365-4e6e-91f8-839e978ae5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:45.421286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 979/1949] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:45.429022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736b261-ac4a-4f8c-a788-12f4b54eb2bb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.432560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736b261-ac4a-4f8c-a788-12f4b54eb2bb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.432560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736b261-ac4a-4f8c-a788-12f4b54eb2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.449924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1736b261-ac4a-4f8c-a788-12f4b54eb2bb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:45.451122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1736b261-ac4a-4f8c-a788-12f4b54eb2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:45.459350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 980/1950] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:45.463622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736b261-ac4a-4f8c-a788-12f4b54eb2bb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.473141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736b261-ac4a-4f8c-a788-12f4b54eb2bb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.480723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 971/1951] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:45.480843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.480843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.480843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.480843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.481130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:45.481130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.482291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.482699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.485030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:45.500339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 981/1952] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:23:45.506556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6cbf-1f2b-4734-9b27-96afc3cee935 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.511772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.516991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405985f6-2f6d-4e8a-8877-707515b6171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.517732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405985f6-2f6d-4e8a-8877-707515b6171b admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.518373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405985f6-2f6d-4e8a-8877-707515b6171b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.518744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405985f6-2f6d-4e8a-8877-707515b6171b admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.519501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405985f6-2f6d-4e8a-8877-707515b6171b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.521257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405985f6-2f6d-4e8a-8877-707515b6171b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.522525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435e61d-e765-4e69-bd44-31d8655e5602 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.527171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e226641-942d-4744-90f0-57a2cd3ca599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.527833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e226641-942d-4744-90f0-57a2cd3ca599 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.528117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e226641-942d-4744-90f0-57a2cd3ca599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.528416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e226641-942d-4744-90f0-57a2cd3ca599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.529089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e226641-942d-4744-90f0-57a2cd3ca599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.531493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e226641-942d-4744-90f0-57a2cd3ca599 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.536607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 972/1953] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:45.537796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405985f6-2f6d-4e8a-8877-707515b6171b admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.549575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405985f6-2f6d-4e8a-8877-707515b6171b admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.553395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:45.555231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d03d9e-1b44-4fca-98cd-216266c85c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.555838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d03d9e-1b44-4fca-98cd-216266c85c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.556119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d03d9e-1b44-4fca-98cd-216266c85c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.556441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d03d9e-1b44-4fca-98cd-216266c85c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.557146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d03d9e-1b44-4fca-98cd-216266c85c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.560425 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d03d9e-1b44-4fca-98cd-216266c85c48 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.563052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:45.573006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 973/1954] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:45.583277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d03d9e-1b44-4fca-98cd-216266c85c48 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.597950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d03d9e-1b44-4fca-98cd-216266c85c48 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.603077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5857f7d-af86-4e79-b5c2-144571728c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.603807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857f7d-af86-4e79-b5c2-144571728c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.603990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857f7d-af86-4e79-b5c2-144571728c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.604257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857f7d-af86-4e79-b5c2-144571728c81 admin admin] PATH_INFO: `/v3/projects/db489663fc1c4327939495d5570b2fec/users/0a96240755404b9caf00b70777fd3fd4/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.622000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5857f7d-af86-4e79-b5c2-144571728c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db489663fc1c4327939495d5570b2fec, user_id=0a96240755404b9caf00b70777fd3fd4, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.625473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5857f7d-af86-4e79-b5c2-144571728c81 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.644059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 982/1955] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:45.648636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e226641-942d-4744-90f0-57a2cd3ca599 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.718337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 974/1956] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:45 2022] PUT /identity/v3/projects/db489663fc1c4327939495d5570b2fec/users/0a96240755404b9caf00b70777fd3fd4/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:45.719952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3fc4d-5e40-4260-97bb-93355c18374c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.720236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3fc4d-5e40-4260-97bb-93355c18374c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.720533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3fc4d-5e40-4260-97bb-93355c18374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.733203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e226641-942d-4744-90f0-57a2cd3ca599 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.751050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-89d3fc4d-5e40-4260-97bb-93355c18374c None None] MFA Rules not processed for user `0a96240755404b9caf00b70777fd3fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:45.752252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-89d3fc4d-5e40-4260-97bb-93355c18374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:45.803013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f50da-b2a9-4729-9506-c1b793466192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.803783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f50da-b2a9-4729-9506-c1b793466192 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.804142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f50da-b2a9-4729-9506-c1b793466192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.804562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f50da-b2a9-4729-9506-c1b793466192 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.805481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f50da-b2a9-4729-9506-c1b793466192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.807468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f50da-b2a9-4729-9506-c1b793466192 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.821490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 975/1957] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:45.827009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3fc4d-5e40-4260-97bb-93355c18374c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.844708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3fc4d-5e40-4260-97bb-93355c18374c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.849192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d1235-b282-408c-a9ea-8b6ad2b6c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.849845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d1235-b282-408c-a9ea-8b6ad2b6c264 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.850127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d1235-b282-408c-a9ea-8b6ad2b6c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.850396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d1235-b282-408c-a9ea-8b6ad2b6c264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.851050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d1235-b282-408c-a9ea-8b6ad2b6c264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.853014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d1235-b282-408c-a9ea-8b6ad2b6c264 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.949336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 983/1958] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:45.956550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f50da-b2a9-4729-9506-c1b793466192 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.966814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f50da-b2a9-4729-9506-c1b793466192 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:45.975030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44646102-d737-42d6-92db-6374553d6bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:45.981748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646102-d737-42d6-92db-6374553d6bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:45.981748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646102-d737-42d6-92db-6374553d6bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:45.981748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44646102-d737-42d6-92db-6374553d6bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:45.981748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44646102-d737-42d6-92db-6374553d6bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:45.982265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 976/1959] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:45.982360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44646102-d737-42d6-92db-6374553d6bbd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:45.985222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d1235-b282-408c-a9ea-8b6ad2b6c264 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:45.995913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 984/1960] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:45.999929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44646102-d737-42d6-92db-6374553d6bbd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.011200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44646102-d737-42d6-92db-6374553d6bbd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.063176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d1235-b282-408c-a9ea-8b6ad2b6c264 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.068183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383726a3-29c1-41ce-9e2d-4f1ebaf76b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.068902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383726a3-29c1-41ce-9e2d-4f1ebaf76b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.069146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383726a3-29c1-41ce-9e2d-4f1ebaf76b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.069548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383726a3-29c1-41ce-9e2d-4f1ebaf76b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.070183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383726a3-29c1-41ce-9e2d-4f1ebaf76b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.072100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383726a3-29c1-41ce-9e2d-4f1ebaf76b98 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.078821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de774-e224-4d6f-88c3-0518f826c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.079605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de774-e224-4d6f-88c3-0518f826c439 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.080095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de774-e224-4d6f-88c3-0518f826c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.080437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de774-e224-4d6f-88c3-0518f826c439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.081597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de774-e224-4d6f-88c3-0518f826c439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.084185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de774-e224-4d6f-88c3-0518f826c439 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.094801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 985/1961] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:46.170911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de774-e224-4d6f-88c3-0518f826c439 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.181403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de774-e224-4d6f-88c3-0518f826c439 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.186738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20c2f7-c4a7-4e47-9126-84ae59417942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.187399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20c2f7-c4a7-4e47-9126-84ae59417942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.187686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20c2f7-c4a7-4e47-9126-84ae59417942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.187964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20c2f7-c4a7-4e47-9126-84ae59417942 admin admin] PATH_INFO: `/v3/projects/b034ddebba734e42aa29b025cca19d98/users/3e0d745a4fc64199af829f8e94b05d95/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.222391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20c2f7-c4a7-4e47-9126-84ae59417942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b034ddebba734e42aa29b025cca19d98, user_id=3e0d745a4fc64199af829f8e94b05d95, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.222391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20c2f7-c4a7-4e47-9126-84ae59417942 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.315811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 977/1962] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:45 2022] POST /identity/v3/users => generated 296 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:46.319673 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383726a3-29c1-41ce-9e2d-4f1ebaf76b98 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.322369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 986/1963] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:46 2022] PUT /identity/v3/projects/b034ddebba734e42aa29b025cca19d98/users/3e0d745a4fc64199af829f8e94b05d95/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:46.331281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383726a3-29c1-41ce-9e2d-4f1ebaf76b98 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.383040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5686daa-4b69-4a80-a899-5c8411fb937c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.383040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5686daa-4b69-4a80-a899-5c8411fb937c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.383040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5686daa-4b69-4a80-a899-5c8411fb937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.386797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.423617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021955ed-9e21-4f00-a77b-acd8ab1f7a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.424238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021955ed-9e21-4f00-a77b-acd8ab1f7a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.424552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021955ed-9e21-4f00-a77b-acd8ab1f7a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.424824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021955ed-9e21-4f00-a77b-acd8ab1f7a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.425479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021955ed-9e21-4f00-a77b-acd8ab1f7a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.427359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021955ed-9e21-4f00-a77b-acd8ab1f7a16 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.429997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d5686daa-4b69-4a80-a899-5c8411fb937c None None] MFA Rules not processed for user `3e0d745a4fc64199af829f8e94b05d95`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:46.431231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d5686daa-4b69-4a80-a899-5c8411fb937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:46.444363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 978/1964] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:46.448586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021955ed-9e21-4f00-a77b-acd8ab1f7a16 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.460207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021955ed-9e21-4f00-a77b-acd8ab1f7a16 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.465516 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990d9f-5928-4b3c-9026-b3a487fcbd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.466523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990d9f-5928-4b3c-9026-b3a487fcbd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.467138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990d9f-5928-4b3c-9026-b3a487fcbd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.468528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990d9f-5928-4b3c-9026-b3a487fcbd04 admin admin] PATH_INFO: `/v3/projects/07bcdab484ec41d1ad1b01a052ed5d7a/users/6adc62831ed3485791513fbf869081ee/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.487213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990d9f-5928-4b3c-9026-b3a487fcbd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bcdab484ec41d1ad1b01a052ed5d7a, user_id=6adc62831ed3485791513fbf869081ee, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.490692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990d9f-5928-4b3c-9026-b3a487fcbd04 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.492604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.538753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 987/1965] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:46.543176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5686daa-4b69-4a80-a899-5c8411fb937c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.554812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5686daa-4b69-4a80-a899-5c8411fb937c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.561062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f1b5d-f3a9-4eeb-af85-bca08de0dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.562394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f1b5d-f3a9-4eeb-af85-bca08de0dfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.562748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f1b5d-f3a9-4eeb-af85-bca08de0dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.563082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f1b5d-f3a9-4eeb-af85-bca08de0dfe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.563783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f1b5d-f3a9-4eeb-af85-bca08de0dfe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.565979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f1b5d-f3a9-4eeb-af85-bca08de0dfe5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.645934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 979/1966] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:46 2022] PUT /identity/v3/projects/07bcdab484ec41d1ad1b01a052ed5d7a/users/6adc62831ed3485791513fbf869081ee/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:46.650060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990d9f-5928-4b3c-9026-b3a487fcbd04 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.684540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 988/1967] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:46 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:46.689590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f1b5d-f3a9-4eeb-af85-bca08de0dfe5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.730585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990d9f-5928-4b3c-9026-b3a487fcbd04 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.774818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f1b5d-f3a9-4eeb-af85-bca08de0dfe5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.779476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355edab-2998-4642-9884-82ebffa38f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.780640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355edab-2998-4642-9884-82ebffa38f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.780913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355edab-2998-4642-9884-82ebffa38f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.781177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355edab-2998-4642-9884-82ebffa38f4c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.781800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355edab-2998-4642-9884-82ebffa38f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.783687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355edab-2998-4642-9884-82ebffa38f4c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.791957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f52266-1d56-4b5f-acbd-1dd1fcaf89c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.792766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52266-1d56-4b5f-acbd-1dd1fcaf89c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.793141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52266-1d56-4b5f-acbd-1dd1fcaf89c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.793738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f52266-1d56-4b5f-acbd-1dd1fcaf89c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.794465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f52266-1d56-4b5f-acbd-1dd1fcaf89c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.797010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f52266-1d56-4b5f-acbd-1dd1fcaf89c7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.807555 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 980/1968] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:46.817085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f52266-1d56-4b5f-acbd-1dd1fcaf89c7 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.827393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f52266-1d56-4b5f-acbd-1dd1fcaf89c7 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.832298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190806d-d46f-46a6-bc06-d7724d7491d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.833268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190806d-d46f-46a6-bc06-d7724d7491d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.833691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190806d-d46f-46a6-bc06-d7724d7491d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.834195 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190806d-d46f-46a6-bc06-d7724d7491d4 admin admin] PATH_INFO: `/v3/projects/07bcdab484ec41d1ad1b01a052ed5d7a/users/6adc62831ed3485791513fbf869081ee/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.837401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190806d-d46f-46a6-bc06-d7724d7491d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bcdab484ec41d1ad1b01a052ed5d7a, user_id=6adc62831ed3485791513fbf869081ee, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.840267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190806d-d46f-46a6-bc06-d7724d7491d4 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:46.852590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 981/1969] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:46 2022] PUT /identity/v3/projects/07bcdab484ec41d1ad1b01a052ed5d7a/users/6adc62831ed3485791513fbf869081ee/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:46.864746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ba31-3b25-45a7-8104-174297c5aebc None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.866549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ba31-3b25-45a7-8104-174297c5aebc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.866549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ba31-3b25-45a7-8104-174297c5aebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.887581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 989/1970] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:46 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:46.892409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355edab-2998-4642-9884-82ebffa38f4c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:46.905719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355edab-2998-4642-9884-82ebffa38f4c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:46.907147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ecb0ba31-3b25-45a7-8104-174297c5aebc None None] MFA Rules not processed for user `6adc62831ed3485791513fbf869081ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:46.909882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ecb0ba31-3b25-45a7-8104-174297c5aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:46.943153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.969710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.986099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e103d-3695-49f6-9181-833ed1b94999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:46.987282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e103d-3695-49f6-9181-833ed1b94999 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:46.987472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e103d-3695-49f6-9181-833ed1b94999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:46.987759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e103d-3695-49f6-9181-833ed1b94999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:46.990050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e103d-3695-49f6-9181-833ed1b94999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:46.991712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e103d-3695-49f6-9181-833ed1b94999 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:47.009284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 990/1971] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:47.009284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e103d-3695-49f6-9181-833ed1b94999 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:47.015622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 982/1972] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:47.026207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e103d-3695-49f6-9181-833ed1b94999 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:47.027916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ba31-3b25-45a7-8104-174297c5aebc None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:47.029564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ecb0ba31-3b25-45a7-8104-174297c5aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:47.035688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b56ca-dd01-4dea-8dc0-9e54b29f263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:47.038074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b56ca-dd01-4dea-8dc0-9e54b29f263b admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:47.038074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b56ca-dd01-4dea-8dc0-9e54b29f263b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:47.038074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b56ca-dd01-4dea-8dc0-9e54b29f263b admin admin] PATH_INFO: `/v3/projects/d50e559791444ea0a211fed971e93408/users/4d66126783044b5095d5e389d9521921/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:47.060251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b56ca-dd01-4dea-8dc0-9e54b29f263b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50e559791444ea0a211fed971e93408, user_id=4d66126783044b5095d5e389d9521921, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:47.063474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b56ca-dd01-4dea-8dc0-9e54b29f263b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:47.102239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ba31-3b25-45a7-8104-174297c5aebc None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:47.106753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b77c-2848-4c9c-82d6-a885992f2e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:47.108641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b77c-2848-4c9c-82d6-a885992f2e17 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:47.108641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b77c-2848-4c9c-82d6-a885992f2e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:47.112478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6b77c-2848-4c9c-82d6-a885992f2e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:47.120534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6b77c-2848-4c9c-82d6-a885992f2e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:47.121632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6b77c-2848-4c9c-82d6-a885992f2e17 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:47.136427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 991/1973] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:47 2022] PUT /identity/v3/projects/d50e559791444ea0a211fed971e93408/users/4d66126783044b5095d5e389d9521921/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:47.140955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 983/1974] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:47.143542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b56ca-dd01-4dea-8dc0-9e54b29f263b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:47.210303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b56ca-dd01-4dea-8dc0-9e54b29f263b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:47.215210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:47.215836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:47.216117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:47.216425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:47.217083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:47.219236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:47.230804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 992/1975] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:47.235035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b77c-2848-4c9c-82d6-a885992f2e17 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:47.247424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6b77c-2848-4c9c-82d6-a885992f2e17 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:47.257334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3cc6f-427c-4a77-a967-8b2195be25c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:47.258067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3cc6f-427c-4a77-a967-8b2195be25c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:47.258447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3cc6f-427c-4a77-a967-8b2195be25c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:47.258777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3cc6f-427c-4a77-a967-8b2195be25c1 admin admin] PATH_INFO: `/v3/projects/d50e559791444ea0a211fed971e93408/users/4d66126783044b5095d5e389d9521921/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:47.262977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3cc6f-427c-4a77-a967-8b2195be25c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50e559791444ea0a211fed971e93408, user_id=4d66126783044b5095d5e389d9521921, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:47.267484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3cc6f-427c-4a77-a967-8b2195be25c1 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:47.270180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:47.272257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:47.292345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 984/1976] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:47 2022] PUT /identity/v3/projects/d50e559791444ea0a211fed971e93408/users/4d66126783044b5095d5e389d9521921/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:47.305122 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce2d6-135d-4360-84d9-805972d86492 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:47.305511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce2d6-135d-4360-84d9-805972d86492 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:47.306019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce2d6-135d-4360-84d9-805972d86492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:47.337361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-42dce2d6-135d-4360-84d9-805972d86492 None None] MFA Rules not processed for user `4d66126783044b5095d5e389d9521921`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:47.338599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-42dce2d6-135d-4360-84d9-805972d86492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:47.360479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a25ac2-7a68-4e18-8cbb-55d3b444cbb1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:47.422318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9cc68-0b64-4ec8-817d-4a0067e0c931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:47.423748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cc68-0b64-4ec8-817d-4a0067e0c931 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:47.424042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cc68-0b64-4ec8-817d-4a0067e0c931 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:47.424351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cc68-0b64-4ec8-817d-4a0067e0c931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:47.426232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cdd9cc68-0b64-4ec8-817d-4a0067e0c931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:47.461602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:47.468224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 985/1977] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:47.485207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce2d6-135d-4360-84d9-805972d86492 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:47.498365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce2d6-135d-4360-84d9-805972d86492 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:47.503452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d334b5-6c43-472a-86a0-9eeda159de7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:47.504213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d334b5-6c43-472a-86a0-9eeda159de7d service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:47.504613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d334b5-6c43-472a-86a0-9eeda159de7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:47.504979 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d334b5-6c43-472a-86a0-9eeda159de7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:47.516152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d334b5-6c43-472a-86a0-9eeda159de7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:47.517695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d334b5-6c43-472a-86a0-9eeda159de7d service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:47.523163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9cc68-0b64-4ec8-817d-4a0067e0c931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:47.525251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9cc68-0b64-4ec8-817d-4a0067e0c931 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:47.530107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 986/1978] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:47.551343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 993/1979] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:47.566653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d334b5-6c43-472a-86a0-9eeda159de7d service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:47.591465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:47.637991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d334b5-6c43-472a-86a0-9eeda159de7d service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:47.643286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:47.644587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:47.644587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:47.644788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] PATH_INFO: `/v3/users/3e0d745a4fc64199af829f8e94b05d95` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:47.646342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0d745a4fc64199af829f8e94b05d95)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:47.648258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:47.956242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0d745a4fc64199af829f8e94b05d95'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:48.045556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0d745a4fc64199af829f8e94b05d95'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:48.046235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0d745a4fc64199af829f8e94b05d95'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:48.059960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0d745a4fc64199af829f8e94b05d95'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:48.060734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0d745a4fc64199af829f8e94b05d95'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:48.076240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 987/1980] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:47 2022] DELETE /identity/v3/users/3e0d745a4fc64199af829f8e94b05d95 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:48.082152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ff4f-a93f-440a-b6e3-84ebd7804e98 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:48.094032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ff4f-a93f-440a-b6e3-84ebd7804e98 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:48.094032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5ff4f-a93f-440a-b6e3-84ebd7804e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:48.103523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1cb5ff4f-a93f-440a-b6e3-84ebd7804e98 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:48.104642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1cb5ff4f-a93f-440a-b6e3-84ebd7804e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:48.190752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 994/1981] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:48.200563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:48.202233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:48.277855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969a1fc-b257-48ce-8470-f538550da7ce admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:48.281570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfc3c-4bee-45c6-82db-428e43e38732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:48.282187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfc3c-4bee-45c6-82db-428e43e38732 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:48.282469 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfc3c-4bee-45c6-82db-428e43e38732 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:48.282750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bfc3c-4bee-45c6-82db-428e43e38732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:48.292135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bfc3c-4bee-45c6-82db-428e43e38732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:48.293750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bfc3c-4bee-45c6-82db-428e43e38732 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:48.308020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 988/1982] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:48.947465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5ff4f-a93f-440a-b6e3-84ebd7804e98 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:48.947465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1cb5ff4f-a93f-440a-b6e3-84ebd7804e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:48.993311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5ff4f-a93f-440a-b6e3-84ebd7804e98 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:49.006562 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:49.007615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:49.008344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:49.009080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] PATH_INFO: `/v3/projects/b034ddebba734e42aa29b025cca19d98` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:49.012545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b034ddebba734e42aa29b025cca19d98)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:49.015528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:49.127787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b034ddebba734e42aa29b025cca19d98', 'request_id': 'req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.135897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b034ddebba734e42aa29b025cca19d98', 'request_id': 'req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.143579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b034ddebba734e42aa29b025cca19d98', 'request_id': 'req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.240086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] The token cache is being invalidate because project b034ddebba734e42aa29b025cca19d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:49.240409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.241329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24dc99a1-592f-4cd5-8cb8-fb706e99f5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.243702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 995/1983] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:48 2022] DELETE /identity/v3/projects/b034ddebba734e42aa29b025cca19d98 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:49.247686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfc3c-4bee-45c6-82db-428e43e38732 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:49.258818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bfc3c-4bee-45c6-82db-428e43e38732 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:49.339451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:49.360604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:49.361454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:49.361814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:49.362572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] PATH_INFO: `/v3/users/4d66126783044b5095d5e389d9521921` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:49.364075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d66126783044b5095d5e389d9521921)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:49.366134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:49.566813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d66126783044b5095d5e389d9521921'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.621747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d66126783044b5095d5e389d9521921'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.622425 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d66126783044b5095d5e389d9521921'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.636164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d66126783044b5095d5e389d9521921'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.637107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-79aa9667-7568-4ea2-9768-b87c78932638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d66126783044b5095d5e389d9521921'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:49.650437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 989/1984] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:49 2022] DELETE /identity/v3/users/4d66126783044b5095d5e389d9521921 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:49.665059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc58df-831e-4b9c-b6e7-123e175662ca None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:49.665453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc58df-831e-4b9c-b6e7-123e175662ca None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:49.665828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc58df-831e-4b9c-b6e7-123e175662ca None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:49.667661 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 996/1985] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:23:49.708639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171647e-4ac2-4ca3-baa0-97a9f3f12108 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:49.708933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171647e-4ac2-4ca3-baa0-97a9f3f12108 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:49.709213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171647e-4ac2-4ca3-baa0-97a9f3f12108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:49.733866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f171647e-4ac2-4ca3-baa0-97a9f3f12108 None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:49.735450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f171647e-4ac2-4ca3-baa0-97a9f3f12108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:49.797602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc58df-831e-4b9c-b6e7-123e175662ca None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:49.801986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e5cc58df-831e-4b9c-b6e7-123e175662ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:49.829303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 990/1986] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:23:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:49.842098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171647e-4ac2-4ca3-baa0-97a9f3f12108 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:49.843695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f171647e-4ac2-4ca3-baa0-97a9f3f12108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:49.859822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171647e-4ac2-4ca3-baa0-97a9f3f12108 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:49.865892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:49.866514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:49.866791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:49.867064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:49.867857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:49.876836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:49.878610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:49.885998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc58df-831e-4b9c-b6e7-123e175662ca None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:49.890582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 991/1987] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:49.891908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:49.892698 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:49.893255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:49.893524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] PATH_INFO: `/v3/users/8bdb4c1d97ec4212ab56e8be7ff879ff` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:49.894669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdb4c1d97ec4212ab56e8be7ff879ff)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:49.896615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:50.109806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdb4c1d97ec4212ab56e8be7ff879ff'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.110447 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdb4c1d97ec4212ab56e8be7ff879ff'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.143224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:50.145266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:50.158883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd05fef-6f22-471b-b555-f32179fa21cc service placement] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:50.164056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:50.164759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:50.165126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:50.165401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] PATH_INFO: `/v3/projects/d50e559791444ea0a211fed971e93408` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:50.166537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50e559791444ea0a211fed971e93408)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:50.168488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:50.210233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdb4c1d97ec4212ab56e8be7ff879ff'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.236113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdb4c1d97ec4212ab56e8be7ff879ff'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.240302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdb4c1d97ec4212ab56e8be7ff879ff'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.246231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 997/1988] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:49 2022] DELETE /identity/v3/users/8bdb4c1d97ec4212ab56e8be7ff879ff => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:50.325557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:50.332512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50e559791444ea0a211fed971e93408', 'request_id': 'req-8a2f015a-2a1c-469e-aedf-6294d2a467db'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.338655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50e559791444ea0a211fed971e93408', 'request_id': 'req-8a2f015a-2a1c-469e-aedf-6294d2a467db'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.346360 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50e559791444ea0a211fed971e93408', 'request_id': 'req-8a2f015a-2a1c-469e-aedf-6294d2a467db'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.427520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:50.431611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:50.456657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] The token cache is being invalidate because project d50e559791444ea0a211fed971e93408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:50.456958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.457688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8a2f015a-2a1c-469e-aedf-6294d2a467db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.459273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 992/1989] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:50 2022] DELETE /identity/v3/projects/d50e559791444ea0a211fed971e93408 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:50.464785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f348d-d3b3-4eb8-a63e-3f528bf0e3f0 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:50.465438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f348d-d3b3-4eb8-a63e-3f528bf0e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:50.465854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f348d-d3b3-4eb8-a63e-3f528bf0e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:50.504494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-716f348d-d3b3-4eb8-a63e-3f528bf0e3f0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:50.505807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-716f348d-d3b3-4eb8-a63e-3f528bf0e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:50.525030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f495d-9327-4ab7-bdeb-a725a049c69d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:50.576621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 993/1990] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:50.584406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f348d-d3b3-4eb8-a63e-3f528bf0e3f0 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:50.585897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-716f348d-d3b3-4eb8-a63e-3f528bf0e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:50.588779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:50.589424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:50.589705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:50.589983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] PATH_INFO: `/v3/users/2fcc5fdb677c4eb9addd184280cafd74` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:50.591299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcc5fdb677c4eb9addd184280cafd74)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:50.593787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:50.599363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f348d-d3b3-4eb8-a63e-3f528bf0e3f0 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:50.604123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:50.604801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:50.605083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:50.605355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] PATH_INFO: `/v3/projects/79b8312155724fd2aaf494f06a6241ec` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:50.606521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b8312155724fd2aaf494f06a6241ec)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:50.608470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:50.772127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:50.788814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b8312155724fd2aaf494f06a6241ec', 'request_id': 'req-668a7f66-df50-4bb7-8bfd-98a342004312'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.791455 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcc5fdb677c4eb9addd184280cafd74'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.792200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcc5fdb677c4eb9addd184280cafd74'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.795698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b8312155724fd2aaf494f06a6241ec', 'request_id': 'req-668a7f66-df50-4bb7-8bfd-98a342004312'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.802104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b8312155724fd2aaf494f06a6241ec', 'request_id': 'req-668a7f66-df50-4bb7-8bfd-98a342004312'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.935647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcc5fdb677c4eb9addd184280cafd74'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.944532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcc5fdb677c4eb9addd184280cafd74'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.958328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fff5a565-ebe2-47cc-8159-9dba33ff8a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcc5fdb677c4eb9addd184280cafd74'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:50.965528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 998/1991] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:50 2022] DELETE /identity/v3/users/2fcc5fdb677c4eb9addd184280cafd74 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:50.969320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90be1e-c837-4572-a1db-092705da640e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:50.969320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90be1e-c837-4572-a1db-092705da640e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:50.969320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90be1e-c837-4572-a1db-092705da640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:50.987151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6b90be1e-c837-4572-a1db-092705da640e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:50.988449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6b90be1e-c837-4572-a1db-092705da640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:50.997865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] The token cache is being invalidate because project 79b8312155724fd2aaf494f06a6241ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:51.003773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:51.003773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-668a7f66-df50-4bb7-8bfd-98a342004312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:51.003773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 994/1992] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:50 2022] DELETE /identity/v3/projects/79b8312155724fd2aaf494f06a6241ec => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:51.003773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d85d5-9f58-4eae-a776-7efb07c085f6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.003773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d85d5-9f58-4eae-a776-7efb07c085f6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.003773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d85d5-9f58-4eae-a776-7efb07c085f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.021470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-117d85d5-9f58-4eae-a776-7efb07c085f6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:51.022677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-117d85d5-9f58-4eae-a776-7efb07c085f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:51.049592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 999/1993] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:51.050848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050022-6ac9-4380-8521-bb9f33519641 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.051161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050022-6ac9-4380-8521-bb9f33519641 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.051407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050022-6ac9-4380-8521-bb9f33519641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.070563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7d050022-6ac9-4380-8521-bb9f33519641 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:51.072696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7d050022-6ac9-4380-8521-bb9f33519641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:51.081821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1000/1994] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:51.082649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d050022-6ac9-4380-8521-bb9f33519641 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.083742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 995/1995] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:51.090856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747836f-d34f-46ff-ab60-3a1b8acd56f3 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.091235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747836f-d34f-46ff-ab60-3a1b8acd56f3 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.091612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747836f-d34f-46ff-ab60-3a1b8acd56f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.092556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d050022-6ac9-4380-8521-bb9f33519641 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.098279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.098894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.099176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.099451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.100118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:51.100449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.102046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.112746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5747836f-d34f-46ff-ab60-3a1b8acd56f3 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:51.117476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1001/1996] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:51.117632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5747836f-d34f-46ff-ab60-3a1b8acd56f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:51.117730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.117730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:51.122715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 996/1997] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:51.126057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747836f-d34f-46ff-ab60-3a1b8acd56f3 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.133020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747836f-d34f-46ff-ab60-3a1b8acd56f3 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.136528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:51.139459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befa85a-b7b0-4cd3-9d51-1a9966679302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.140682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befa85a-b7b0-4cd3-9d51-1a9966679302 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.141147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befa85a-b7b0-4cd3-9d51-1a9966679302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.141479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befa85a-b7b0-4cd3-9d51-1a9966679302 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.142104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befa85a-b7b0-4cd3-9d51-1a9966679302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.144627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befa85a-b7b0-4cd3-9d51-1a9966679302 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.175013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0c684-436e-4918-9afe-1427378d5dbe admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.178598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d51d5-750f-474b-834c-700d4ed8f16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.179212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d51d5-750f-474b-834c-700d4ed8f16b service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.179493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d51d5-750f-474b-834c-700d4ed8f16b service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.179765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d51d5-750f-474b-834c-700d4ed8f16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.189119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d51d5-750f-474b-834c-700d4ed8f16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.190477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d51d5-750f-474b-834c-700d4ed8f16b service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.199601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1002/1998] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:51.200378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d51d5-750f-474b-834c-700d4ed8f16b service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.210488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d51d5-750f-474b-834c-700d4ed8f16b service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.215274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.215877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.216159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.216484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.217129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:51.217433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.219133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.231017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1003/1999] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:51.237043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.247701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 997/2000] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:51.247826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7516-b12c-4df2-a807-29b7adf4631a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.251255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befa85a-b7b0-4cd3-9d51-1a9966679302 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.317057 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a788-c6e0-489a-a789-1ad6bcbb5cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.317738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a788-c6e0-489a-a789-1ad6bcbb5cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.318021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a788-c6e0-489a-a789-1ad6bcbb5cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.328159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a788-c6e0-489a-a789-1ad6bcbb5cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.328159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a788-c6e0-489a-a789-1ad6bcbb5cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.328159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0a788-c6e0-489a-a789-1ad6bcbb5cb4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.328609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befa85a-b7b0-4cd3-9d51-1a9966679302 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.328609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2ad0-9ef6-4d1a-a714-9c8dcca1ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.328609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2ad0-9ef6-4d1a-a714-9c8dcca1ccc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.328609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2ad0-9ef6-4d1a-a714-9c8dcca1ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.329279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2ad0-9ef6-4d1a-a714-9c8dcca1ccc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.329279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea2ad0-9ef6-4d1a-a714-9c8dcca1ccc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.330811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea2ad0-9ef6-4d1a-a714-9c8dcca1ccc2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.417177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 998/2001] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:51.421796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1004/2002] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:51.423337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2ad0-9ef6-4d1a-a714-9c8dcca1ccc2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.424686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a788-c6e0-489a-a789-1ad6bcbb5cb4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.434663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2ad0-9ef6-4d1a-a714-9c8dcca1ccc2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.493385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a788-c6e0-489a-a789-1ad6bcbb5cb4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.498151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9010a9-5cac-4a7f-8e92-d3c89528ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.498778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9010a9-5cac-4a7f-8e92-d3c89528ca78 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.499062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9010a9-5cac-4a7f-8e92-d3c89528ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.499854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9010a9-5cac-4a7f-8e92-d3c89528ca78 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.500528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9010a9-5cac-4a7f-8e92-d3c89528ca78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.502208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc868-f113-41ed-9831-0d5674d43635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.505722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9010a9-5cac-4a7f-8e92-d3c89528ca78 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.505851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc868-f113-41ed-9831-0d5674d43635 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.505851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc868-f113-41ed-9831-0d5674d43635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.505851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc868-f113-41ed-9831-0d5674d43635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.505851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cc868-f113-41ed-9831-0d5674d43635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.506736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cc868-f113-41ed-9831-0d5674d43635 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.520176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 999/2003] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:51.524079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc868-f113-41ed-9831-0d5674d43635 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.535488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc868-f113-41ed-9831-0d5674d43635 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.542101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb025898-cda8-47fa-a768-2bca7c6ce969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.542734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb025898-cda8-47fa-a768-2bca7c6ce969 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.543425 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb025898-cda8-47fa-a768-2bca7c6ce969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.543557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb025898-cda8-47fa-a768-2bca7c6ce969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.544226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb025898-cda8-47fa-a768-2bca7c6ce969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.546080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb025898-cda8-47fa-a768-2bca7c6ce969 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.558074 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1000/2004] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:51.566874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb025898-cda8-47fa-a768-2bca7c6ce969 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.580813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb025898-cda8-47fa-a768-2bca7c6ce969 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.597596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1005/2005] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:51.597732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.597732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.597732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.597970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] PATH_INFO: `/v3/projects/b8257696af214b67b7bc36a7b29652d2/users/3e7c3648a1d34a16996c10f94fa3538a/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.600403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9010a9-5cac-4a7f-8e92-d3c89528ca78 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.612850 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9010a9-5cac-4a7f-8e92-d3c89528ca78 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.619400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c1dc-b1fa-46db-acec-b582b2a1cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.620100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c1dc-b1fa-46db-acec-b582b2a1cacd admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.620481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c1dc-b1fa-46db-acec-b582b2a1cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.620869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008c1dc-b1fa-46db-acec-b582b2a1cacd admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.626089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008c1dc-b1fa-46db-acec-b582b2a1cacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.626089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008c1dc-b1fa-46db-acec-b582b2a1cacd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.628846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8257696af214b67b7bc36a7b29652d2, user_id=3e7c3648a1d34a16996c10f94fa3538a, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.632972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.634984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1006/2006] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:51.638993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c1dc-b1fa-46db-acec-b582b2a1cacd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.649437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008c1dc-b1fa-46db-acec-b582b2a1cacd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.654177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66459-ffc5-4013-9892-136cde8c78d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.660694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66459-ffc5-4013-9892-136cde8c78d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.660694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66459-ffc5-4013-9892-136cde8c78d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.660694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66459-ffc5-4013-9892-136cde8c78d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.660694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af66459-ffc5-4013-9892-136cde8c78d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.660694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af66459-ffc5-4013-9892-136cde8c78d9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.669356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1007/2007] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:51.674379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66459-ffc5-4013-9892-136cde8c78d9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.683792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66459-ffc5-4013-9892-136cde8c78d9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.689375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5543a-dcbe-46fd-8fd0-c667c5b5c6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.690099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5543a-dcbe-46fd-8fd0-c667c5b5c6be admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.690470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5543a-dcbe-46fd-8fd0-c667c5b5c6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.690744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5543a-dcbe-46fd-8fd0-c667c5b5c6be admin admin] PATH_INFO: `/v3/projects/7b55585d971049c38381d4d9a3ca8222/users/bed04af5d690480e9739f3d87cabfadf/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.706881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5543a-dcbe-46fd-8fd0-c667c5b5c6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b55585d971049c38381d4d9a3ca8222, user_id=bed04af5d690480e9739f3d87cabfadf, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.709610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5543a-dcbe-46fd-8fd0-c667c5b5c6be admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.736786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:51.744900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1001/2008] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:51 2022] PUT /identity/v3/projects/b8257696af214b67b7bc36a7b29652d2/users/3e7c3648a1d34a16996c10f94fa3538a/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:51.745758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.747817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:51.818930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582fefd-58a9-454d-bfe8-f7c17265ea11 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.822425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1008/2009] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:51 2022] PUT /identity/v3/projects/7b55585d971049c38381d4d9a3ca8222/users/bed04af5d690480e9739f3d87cabfadf/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:51.825784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c7bf-9bcf-496c-a480-dbfd71c21f07 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.829285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c7bf-9bcf-496c-a480-dbfd71c21f07 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.829285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06c7bf-9bcf-496c-a480-dbfd71c21f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.872756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1f06c7bf-9bcf-496c-a480-dbfd71c21f07 None None] MFA Rules not processed for user `3e7c3648a1d34a16996c10f94fa3538a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:51.874041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f06c7bf-9bcf-496c-a480-dbfd71c21f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:51.892025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.892758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.893294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.893568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] PATH_INFO: `/v3/projects/d603604ef0564035abb3a805a2650eab` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.894704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d603604ef0564035abb3a805a2650eab)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.896634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:51.944723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1009/2010] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:51.949230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d30e-0e7d-458f-8d77-5fd75b18fef6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.949480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d30e-0e7d-458f-8d77-5fd75b18fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.949970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d30e-0e7d-458f-8d77-5fd75b18fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.969259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e427d30e-0e7d-458f-8d77-5fd75b18fef6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:51.970502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e427d30e-0e7d-458f-8d77-5fd75b18fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:51.978896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1010/2011] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:51.979664 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427d30e-0e7d-458f-8d77-5fd75b18fef6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:51.989318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427d30e-0e7d-458f-8d77-5fd75b18fef6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:51.993953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:51.994544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:51.994825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:51.995096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:51.995715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:51.997620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.056610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd603604ef0564035abb3a805a2650eab', 'request_id': 'req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.062880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd603604ef0564035abb3a805a2650eab', 'request_id': 'req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.068291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:52.070254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd603604ef0564035abb3a805a2650eab', 'request_id': 'req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.117542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1011/2012] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:51 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:52.117542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.117542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.141001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] The token cache is being invalidate because project d603604ef0564035abb3a805a2650eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:52.144768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.144768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.144768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1002/2013] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:51 2022] DELETE /identity/v3/projects/d603604ef0564035abb3a805a2650eab => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:52.144768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.146300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.188178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231e15d-2905-40e0-8f9f-5d6bfd19a1a2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.192660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.193446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.193733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.194012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.196072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.219683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08e6b6-e510-46b5-9575-24c95ecc9f3f admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.262660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.265012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.276817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.277494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.277793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.278109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] PATH_INFO: `/v3/users/816d7a40c3ce42b1aea0b004cee5f02e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.279015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1012/2014] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:52.279347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816d7a40c3ce42b1aea0b004cee5f02e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.279930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.281947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.282159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.298904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc902130-6bb8-4664-99dd-e6deec562ba1 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.305614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfe776-6c85-44cc-8eb9-1dd5a28c249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.306702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfe776-6c85-44cc-8eb9-1dd5a28c249a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.307446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfe776-6c85-44cc-8eb9-1dd5a28c249a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.308224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfe776-6c85-44cc-8eb9-1dd5a28c249a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.309019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfe776-6c85-44cc-8eb9-1dd5a28c249a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.311044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfe776-6c85-44cc-8eb9-1dd5a28c249a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.325066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:52.399076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:52.408739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1013/2015] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:52 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:52.408739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d57b2-a6d7-44fc-9c3a-6a4bb99702fd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.408739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d57b2-a6d7-44fc-9c3a-6a4bb99702fd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.410390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d57b2-a6d7-44fc-9c3a-6a4bb99702fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.430393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2c9d57b2-a6d7-44fc-9c3a-6a4bb99702fd None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:52.431588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c9d57b2-a6d7-44fc-9c3a-6a4bb99702fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.439720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1014/2016] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:52.440688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d57b2-a6d7-44fc-9c3a-6a4bb99702fd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.450342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d57b2-a6d7-44fc-9c3a-6a4bb99702fd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.462035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ff4e8-8e87-4a3b-8905-63e5ea3ccc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.462035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ff4e8-8e87-4a3b-8905-63e5ea3ccc2e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.462035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ff4e8-8e87-4a3b-8905-63e5ea3ccc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.462035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ff4e8-8e87-4a3b-8905-63e5ea3ccc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.462477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ff4e8-8e87-4a3b-8905-63e5ea3ccc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.462477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ff4e8-8e87-4a3b-8905-63e5ea3ccc2e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.462630 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816d7a40c3ce42b1aea0b004cee5f02e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.472216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1015/2017] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:52.473731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bf4e0-e833-4288-a16d-26625ba24657 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.474428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bf4e0-e833-4288-a16d-26625ba24657 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.474756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bf4e0-e833-4288-a16d-26625ba24657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.494004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-960bf4e0-e833-4288-a16d-26625ba24657 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:52.495204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-960bf4e0-e833-4288-a16d-26625ba24657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.503870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1016/2018] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:52.504737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bf4e0-e833-4288-a16d-26625ba24657 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.514177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bf4e0-e833-4288-a16d-26625ba24657 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.519869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e082ee-876f-4877-a6ab-d9ef71bee9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.520575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e082ee-876f-4877-a6ab-d9ef71bee9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.520855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e082ee-876f-4877-a6ab-d9ef71bee9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.521133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e082ee-876f-4877-a6ab-d9ef71bee9b6 admin admin] PATH_INFO: `/v3/projects/a26bdca6319a4fa2aaceb6eb2a4934c5/users/b1d5740fb05e495ea23b3a5cafc6dd44/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.523863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816d7a40c3ce42b1aea0b004cee5f02e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.525437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816d7a40c3ce42b1aea0b004cee5f02e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.536668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e082ee-876f-4877-a6ab-d9ef71bee9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26bdca6319a4fa2aaceb6eb2a4934c5, user_id=b1d5740fb05e495ea23b3a5cafc6dd44, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.538358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816d7a40c3ce42b1aea0b004cee5f02e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.539083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816d7a40c3ce42b1aea0b004cee5f02e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:52.539279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e082ee-876f-4877-a6ab-d9ef71bee9b6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.551226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1003/2019] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:52 2022] DELETE /identity/v3/users/816d7a40c3ce42b1aea0b004cee5f02e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:52.552235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.553635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.612725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:52.620783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6be3-31ce-4897-af90-5111cdbb99e4 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.644171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1017/2020] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:52 2022] PUT /identity/v3/projects/a26bdca6319a4fa2aaceb6eb2a4934c5/users/b1d5740fb05e495ea23b3a5cafc6dd44/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:52.648419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88254f8-8880-4c84-b464-849e610d4a08 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.648419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88254f8-8880-4c84-b464-849e610d4a08 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.648419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88254f8-8880-4c84-b464-849e610d4a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.675022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f88254f8-8880-4c84-b464-849e610d4a08 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:52.676605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f88254f8-8880-4c84-b464-849e610d4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.703882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.711962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.711962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.711962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.711962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:52.711962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.711962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.721493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1004/2021] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:52.722447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.724666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.738094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5ea8-3937-4662-9d68-6925823d63c8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.743840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.744485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.744762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.745032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.745884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.747476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.753047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1018/2022] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:52.753047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88254f8-8880-4c84-b464-849e610d4a08 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.760526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1005/2023] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:52.762691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.765362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:52.767223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88254f8-8880-4c84-b464-849e610d4a08 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.774540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c41b-486d-43ff-a42c-f1d43eef2fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.775346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c41b-486d-43ff-a42c-f1d43eef2fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.775737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c41b-486d-43ff-a42c-f1d43eef2fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.776172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c41b-486d-43ff-a42c-f1d43eef2fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.776963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940c41b-486d-43ff-a42c-f1d43eef2fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.779261 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940c41b-486d-43ff-a42c-f1d43eef2fe9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.834058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6e91a-1837-4d2c-a4d5-57f3b8b171f2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.838135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54489ac3-ce74-4405-a592-a24087d7cf51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.838839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489ac3-ce74-4405-a592-a24087d7cf51 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.839203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489ac3-ce74-4405-a592-a24087d7cf51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.839521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489ac3-ce74-4405-a592-a24087d7cf51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.851223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1019/2024] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:52 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:52.851223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c41b-486d-43ff-a42c-f1d43eef2fe9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.851986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54489ac3-ce74-4405-a592-a24087d7cf51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.853553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54489ac3-ce74-4405-a592-a24087d7cf51 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.863323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:52.868328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1006/2025] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:52.869167 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54489ac3-ce74-4405-a592-a24087d7cf51 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:52.880340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54489ac3-ce74-4405-a592-a24087d7cf51 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.925189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c41b-486d-43ff-a42c-f1d43eef2fe9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:52.930938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9cc2c-67b8-40a1-86a8-fad635799257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.931689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9cc2c-67b8-40a1-86a8-fad635799257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.932207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9cc2c-67b8-40a1-86a8-fad635799257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.932207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9cc2c-67b8-40a1-86a8-fad635799257 admin admin] PATH_INFO: `/v3/projects/a26bdca6319a4fa2aaceb6eb2a4934c5/users/b1d5740fb05e495ea23b3a5cafc6dd44/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.935180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9cc2c-67b8-40a1-86a8-fad635799257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26bdca6319a4fa2aaceb6eb2a4934c5, user_id=b1d5740fb05e495ea23b3a5cafc6dd44, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.938632 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9cc2c-67b8-40a1-86a8-fad635799257 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.953337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a734-5972-4d22-b0a8-7d275273e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:52.954517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a734-5972-4d22-b0a8-7d275273e7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.955012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a734-5972-4d22-b0a8-7d275273e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.955542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739a734-5972-4d22-b0a8-7d275273e7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:52.956494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739a734-5972-4d22-b0a8-7d275273e7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:52.958779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739a734-5972-4d22-b0a8-7d275273e7b6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:52.963631 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1020/2026] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:52 2022] PUT /identity/v3/projects/a26bdca6319a4fa2aaceb6eb2a4934c5/users/b1d5740fb05e495ea23b3a5cafc6dd44/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:52.974434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08f0ca-dc9d-4d65-9e7f-daf499070166 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:52.974709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08f0ca-dc9d-4d65-9e7f-daf499070166 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:52.975208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08f0ca-dc9d-4d65-9e7f-daf499070166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.007799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2c08f0ca-dc9d-4d65-9e7f-daf499070166 None None] MFA Rules not processed for user `b1d5740fb05e495ea23b3a5cafc6dd44`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:53.009194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c08f0ca-dc9d-4d65-9e7f-daf499070166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:53.053851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:53.072513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1007/2027] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:52 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:53.076364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a734-5972-4d22-b0a8-7d275273e7b6 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:53.083170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1021/2028] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:53.090010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739a734-5972-4d22-b0a8-7d275273e7b6 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:53.099944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08f0ca-dc9d-4d65-9e7f-daf499070166 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:53.101371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c08f0ca-dc9d-4d65-9e7f-daf499070166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:53.154837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e821c2a-e427-454e-8366-7daa887f3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:53.155716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e821c2a-e427-454e-8366-7daa887f3cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:53.156137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e821c2a-e427-454e-8366-7daa887f3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:53.156662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e821c2a-e427-454e-8366-7daa887f3cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.158091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e821c2a-e427-454e-8366-7daa887f3cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:53.159830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e821c2a-e427-454e-8366-7daa887f3cd8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:53.174779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1008/2029] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:53.184677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e821c2a-e427-454e-8366-7daa887f3cd8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:53.186043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08f0ca-dc9d-4d65-9e7f-daf499070166 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:53.191745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:53.192361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:53.192654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:53.192954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.198671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e821c2a-e427-454e-8366-7daa887f3cd8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:53.205304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e553ed-7718-4d15-b663-867a078410f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:53.210286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e553ed-7718-4d15-b663-867a078410f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:53.210286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e553ed-7718-4d15-b663-867a078410f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:53.210286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e553ed-7718-4d15-b663-867a078410f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.210286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e553ed-7718-4d15-b663-867a078410f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:53.210658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:53.210777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e553ed-7718-4d15-b663-867a078410f4 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:53.210875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:53.223587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1009/2030] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:53.227432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e553ed-7718-4d15-b663-867a078410f4 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:53.241053 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e553ed-7718-4d15-b663-867a078410f4 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:53.247004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25fa27-4a93-4952-934f-01606c552603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:53.247863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25fa27-4a93-4952-934f-01606c552603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:53.248331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25fa27-4a93-4952-934f-01606c552603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:53.248754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25fa27-4a93-4952-934f-01606c552603 admin admin] PATH_INFO: `/v3/projects/8ed34b9416a54d559853c54a99d83d45/users/417c03798c594b2681776069f77bce5a/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.261728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1022/2031] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:53.279651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25fa27-4a93-4952-934f-01606c552603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed34b9416a54d559853c54a99d83d45, user_id=417c03798c594b2681776069f77bce5a, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:53.284785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25fa27-4a93-4952-934f-01606c552603 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:53.360558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1010/2032] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:53 2022] PUT /identity/v3/projects/8ed34b9416a54d559853c54a99d83d45/users/417c03798c594b2681776069f77bce5a/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:53.361851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:53.363278 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:53.364882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d1084-359f-465f-bb96-9c28d742a994 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:53.365772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d1084-359f-465f-bb96-9c28d742a994 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:53.366062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d1084-359f-465f-bb96-9c28d742a994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.389424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6fc7e-8dac-4771-9435-f52fe78d49b4 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:53.393645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-501d1084-359f-465f-bb96-9c28d742a994 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:53.396045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-501d1084-359f-465f-bb96-9c28d742a994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:53.489019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1011/2033] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:53.498219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d1084-359f-465f-bb96-9c28d742a994 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:53.498907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:53.501190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:53.501559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:53.505995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] PATH_INFO: `/v3/projects/bf5caecde09a47fcb70a5e633ff1cb3c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.505995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5caecde09a47fcb70a5e633ff1cb3c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:53.505995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:53.557813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d1084-359f-465f-bb96-9c28d742a994 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:53.561469 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c2ee0-07b7-4ba8-a6e5-b767e096ac8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:53.562603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c2ee0-07b7-4ba8-a6e5-b767e096ac8a service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:53.562882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c2ee0-07b7-4ba8-a6e5-b767e096ac8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:53.563146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c2ee0-07b7-4ba8-a6e5-b767e096ac8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.572584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c2ee0-07b7-4ba8-a6e5-b767e096ac8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:53.574177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c2ee0-07b7-4ba8-a6e5-b767e096ac8a service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:53.586139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1012/2034] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:23:53.639403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:53.640409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5caecde09a47fcb70a5e633ff1cb3c', 'request_id': 'req-b5fc71b5-8b5c-40da-a380-50fd69175663'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:53.647649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5caecde09a47fcb70a5e633ff1cb3c', 'request_id': 'req-b5fc71b5-8b5c-40da-a380-50fd69175663'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:53.654591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5caecde09a47fcb70a5e633ff1cb3c', 'request_id': 'req-b5fc71b5-8b5c-40da-a380-50fd69175663'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:53.748731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] The token cache is being invalidate because project bf5caecde09a47fcb70a5e633ff1cb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:53.749969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:53.751794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:53.759291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c2ee0-07b7-4ba8-a6e5-b767e096ac8a service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:53.759983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1023/2035] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:53 2022] DELETE /identity/v3/projects/bf5caecde09a47fcb70a5e633ff1cb3c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:53.771495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c2ee0-07b7-4ba8-a6e5-b767e096ac8a service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:53.844092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:53.844747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:53.845024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:53.845314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] PATH_INFO: `/v3/users/0a96240755404b9caf00b70777fd3fd4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:53.846431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a96240755404b9caf00b70777fd3fd4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:53.848402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:54.147334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a96240755404b9caf00b70777fd3fd4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:54.255495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a96240755404b9caf00b70777fd3fd4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:54.256050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a96240755404b9caf00b70777fd3fd4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:54.276226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a96240755404b9caf00b70777fd3fd4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:54.277263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a96240755404b9caf00b70777fd3fd4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:54.287700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:54.299149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1013/2036] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:53 2022] DELETE /identity/v3/users/0a96240755404b9caf00b70777fd3fd4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:54.726569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:54.728374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:54.747899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc71b5-8b5c-40da-a380-50fd69175663 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:54.759914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:54.836656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:54.838402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:54.838940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:54.839365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] PATH_INFO: `/v3/users/3e7c3648a1d34a16996c10f94fa3538a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:54.840894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7c3648a1d34a16996c10f94fa3538a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:54.843913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:54.981085 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:54.983163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:55.003701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e95cc5-12ef-4436-b627-35ce27a08d04 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:55.015543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:55.016201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:55.016511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:55.016782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] PATH_INFO: `/v3/projects/db489663fc1c4327939495d5570b2fec` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:55.018342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db489663fc1c4327939495d5570b2fec)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:55.020735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:55.088352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7c3648a1d34a16996c10f94fa3538a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.090878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7c3648a1d34a16996c10f94fa3538a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.203476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7c3648a1d34a16996c10f94fa3538a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.207245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7c3648a1d34a16996c10f94fa3538a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.235463 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8f080659-9835-4dc8-9e78-18b11cf45847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7c3648a1d34a16996c10f94fa3538a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.239688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db489663fc1c4327939495d5570b2fec', 'request_id': 'req-41928cd5-b47c-404c-a845-a6148a125f97'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.248998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1024/2037] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:54 2022] DELETE /identity/v3/users/3e7c3648a1d34a16996c10f94fa3538a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:55.248998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd6c85-3695-468e-92b6-4f9319339c87 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:55.248998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd6c85-3695-468e-92b6-4f9319339c87 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:55.248998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd6c85-3695-468e-92b6-4f9319339c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:55.255884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db489663fc1c4327939495d5570b2fec', 'request_id': 'req-41928cd5-b47c-404c-a845-a6148a125f97'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.274556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db489663fc1c4327939495d5570b2fec', 'request_id': 'req-41928cd5-b47c-404c-a845-a6148a125f97'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.302608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fdcd6c85-3695-468e-92b6-4f9319339c87 None None] MFA Rules not processed for user `417c03798c594b2681776069f77bce5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:55.309717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fdcd6c85-3695-468e-92b6-4f9319339c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:55.379906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1025/2038] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:55.385179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e293a-2c69-4803-8259-61dbaa167527 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:55.385865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e293a-2c69-4803-8259-61dbaa167527 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:55.385865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e293a-2c69-4803-8259-61dbaa167527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:55.406985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-180e293a-2c69-4803-8259-61dbaa167527 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:55.408175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-180e293a-2c69-4803-8259-61dbaa167527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:55.412644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] The token cache is being invalidate because project db489663fc1c4327939495d5570b2fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:55.412939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.413569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.418315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1014/2039] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:54 2022] DELETE /identity/v3/projects/db489663fc1c4327939495d5570b2fec => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:55.418315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:55.418315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:55.491634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1026/2040] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:55.492922 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e293a-2c69-4803-8259-61dbaa167527 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:55.495940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:55.500003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-180e293a-2c69-4803-8259-61dbaa167527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:55.513758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e293a-2c69-4803-8259-61dbaa167527 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:55.514576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41928cd5-b47c-404c-a845-a6148a125f97 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:55.520053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:55.520745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:55.521023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:55.521300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] PATH_INFO: `/v3/users/6adc62831ed3485791513fbf869081ee` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:55.522920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adc62831ed3485791513fbf869081ee)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:55.528888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:55.594272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:55.594940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:55.595219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:55.595488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:55.597567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:55.611624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:55.613132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:55.629220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1015/2041] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:55.637650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:55.642613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:55.730905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adc62831ed3485791513fbf869081ee'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.731925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adc62831ed3485791513fbf869081ee'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.743556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271090e-148e-4a34-b527-19434d25b329 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:55.748409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:55.749369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:55.749755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:55.750121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:55.752252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:55.770060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:55.772150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:55.785118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1016/2042] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:55.794166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adc62831ed3485791513fbf869081ee'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.803743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adc62831ed3485791513fbf869081ee'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.827077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adc62831ed3485791513fbf869081ee'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:55.841916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1027/2043] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:55 2022] DELETE /identity/v3/users/6adc62831ed3485791513fbf869081ee => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:56.627457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:56.628930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:56.644406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76277b85-3fc6-4af2-abd0-593fdea2a138 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:56.688509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:56.691373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:56.754282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:56.757876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:56.757876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:56.757876 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] PATH_INFO: `/v3/projects/07bcdab484ec41d1ad1b01a052ed5d7a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:56.759157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bcdab484ec41d1ad1b01a052ed5d7a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:56.761920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:56.832010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46660d4-9cdd-4e02-9b95-216efb10b71b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:56.837573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:56.838436 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:56.838717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:56.838991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] PATH_INFO: `/v3/projects/b8257696af214b67b7bc36a7b29652d2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:56.840553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8257696af214b67b7bc36a7b29652d2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:56.843315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:56.891181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:56.927210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bcdab484ec41d1ad1b01a052ed5d7a', 'request_id': 'req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:56.936809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bcdab484ec41d1ad1b01a052ed5d7a', 'request_id': 'req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:56.945113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bcdab484ec41d1ad1b01a052ed5d7a', 'request_id': 'req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:56.990566 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8257696af214b67b7bc36a7b29652d2', 'request_id': 'req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:56.998140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8257696af214b67b7bc36a7b29652d2', 'request_id': 'req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.005934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8257696af214b67b7bc36a7b29652d2', 'request_id': 'req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.041623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] The token cache is being invalidate because project 07bcdab484ec41d1ad1b01a052ed5d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:57.046416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.046416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-47dd0386-0d1a-4ebd-bc50-76eb25c7d507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.046416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1017/2044] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:56 2022] DELETE /identity/v3/projects/07bcdab484ec41d1ad1b01a052ed5d7a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:57.050887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83e3e-bc90-46f0-a03b-614b34c18954 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.051180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83e3e-bc90-46f0-a03b-614b34c18954 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.051457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f83e3e-bc90-46f0-a03b-614b34c18954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.075037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-62f83e3e-bc90-46f0-a03b-614b34c18954 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:57.076587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-62f83e3e-bc90-46f0-a03b-614b34c18954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:57.126948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] The token cache is being invalidate because project b8257696af214b67b7bc36a7b29652d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:57.127246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.128030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.132626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1028/2045] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:56 2022] DELETE /identity/v3/projects/b8257696af214b67b7bc36a7b29652d2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:57.134332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:57.135961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:57.164375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1018/2046] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:57.169026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d32abd-8561-4045-99e9-4eb24654878a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.170566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d32abd-8561-4045-99e9-4eb24654878a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.171696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d32abd-8561-4045-99e9-4eb24654878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.193787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-73d32abd-8561-4045-99e9-4eb24654878a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:57.196137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-73d32abd-8561-4045-99e9-4eb24654878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:57.205690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1019/2047] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:57.209414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d32abd-8561-4045-99e9-4eb24654878a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:57.215748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2f92e-c264-4a12-9aa4-836cf3d00a70 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:57.219417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d32abd-8561-4045-99e9-4eb24654878a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:57.222140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:57.222911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.223194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.223468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] PATH_INFO: `/v3/users/b1d5740fb05e495ea23b3a5cafc6dd44` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.224649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d5740fb05e495ea23b3a5cafc6dd44)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:57.225300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:57.225976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.226484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.226794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.226909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:57.228043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:57.228514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:57.230845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:57.244226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1020/2048] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:57.248741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:57.259984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed25c11-c6ca-4014-b784-f0993735fc87 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:57.265684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed83e6a-352c-4796-b096-c63691a14e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:57.272132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83e6a-352c-4796-b096-c63691a14e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.272132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83e6a-352c-4796-b096-c63691a14e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.272132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83e6a-352c-4796-b096-c63691a14e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.272132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed83e6a-352c-4796-b096-c63691a14e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:57.272132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed83e6a-352c-4796-b096-c63691a14e06 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:57.344211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1021/2049] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:57 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:57.348129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed83e6a-352c-4796-b096-c63691a14e06 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:57.420263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed83e6a-352c-4796-b096-c63691a14e06 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:57.427023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:57.427652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.427927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.428198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.428942 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:57.431020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:57.453577 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d5740fb05e495ea23b3a5cafc6dd44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.454420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d5740fb05e495ea23b3a5cafc6dd44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.517570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1022/2050] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:57 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:57.529016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:57.530469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d5740fb05e495ea23b3a5cafc6dd44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.531922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:57.544700 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d5740fb05e495ea23b3a5cafc6dd44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.547950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56ed88-03f2-4cb7-97ff-438ad088076f admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:57.556578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347ded6-0bd4-4bdc-8efb-27ed5bf0d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:57.557609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347ded6-0bd4-4bdc-8efb-27ed5bf0d783 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.558295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347ded6-0bd4-4bdc-8efb-27ed5bf0d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.558504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347ded6-0bd4-4bdc-8efb-27ed5bf0d783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.559226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347ded6-0bd4-4bdc-8efb-27ed5bf0d783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:57.562049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347ded6-0bd4-4bdc-8efb-27ed5bf0d783 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:57.566372 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d5740fb05e495ea23b3a5cafc6dd44'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:57.578776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1029/2051] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:23:57 2022] DELETE /identity/v3/users/b1d5740fb05e495ea23b3a5cafc6dd44 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:57.582537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1023/2052] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:57.583354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:57.669136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdb273-2691-4dd4-9bf1-b9207e25a6fc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:57.676009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b73a48-5b02-40b7-9dd1-8e2990813235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:57.676578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b73a48-5b02-40b7-9dd1-8e2990813235 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.676934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b73a48-5b02-40b7-9dd1-8e2990813235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.677217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b73a48-5b02-40b7-9dd1-8e2990813235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.678516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b73a48-5b02-40b7-9dd1-8e2990813235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:57.679257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:57.679782 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b73a48-5b02-40b7-9dd1-8e2990813235 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:57.695777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1030/2053] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:23:57.696542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347ded6-0bd4-4bdc-8efb-27ed5bf0d783 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:57.709573 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347ded6-0bd4-4bdc-8efb-27ed5bf0d783 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:57.717094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15691d-6bb6-43c4-a2df-2bbffe4bc0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:57.718570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15691d-6bb6-43c4-a2df-2bbffe4bc0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.718908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15691d-6bb6-43c4-a2df-2bbffe4bc0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.719187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15691d-6bb6-43c4-a2df-2bbffe4bc0f9 admin admin] PATH_INFO: `/v3/projects/823d5a6ef2a64536a6697b926b2ce8c0/users/5c08ce5eb5384347bfc4610931102cbb/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.741296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15691d-6bb6-43c4-a2df-2bbffe4bc0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823d5a6ef2a64536a6697b926b2ce8c0, user_id=5c08ce5eb5384347bfc4610931102cbb, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:57.744941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15691d-6bb6-43c4-a2df-2bbffe4bc0f9 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:57.782619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e4624-6a7d-4de6-99d7-684c3e0f1e6e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.782909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e4624-6a7d-4de6-99d7-684c3e0f1e6e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.783220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e4624-6a7d-4de6-99d7-684c3e0f1e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.803111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d75e4624-6a7d-4de6-99d7-684c3e0f1e6e None None] MFA Rules not processed for user `417c03798c594b2681776069f77bce5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:57.804399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d75e4624-6a7d-4de6-99d7-684c3e0f1e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:57.828112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1024/2054] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:57 2022] PUT /identity/v3/projects/823d5a6ef2a64536a6697b926b2ce8c0/users/5c08ce5eb5384347bfc4610931102cbb/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:23:57.832895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5997545-edff-4eff-99ca-a02fed1e9a98 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:57.833288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5997545-edff-4eff-99ca-a02fed1e9a98 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:57.833949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5997545-edff-4eff-99ca-a02fed1e9a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:57.865758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-b5997545-edff-4eff-99ca-a02fed1e9a98 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:57.872422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b5997545-edff-4eff-99ca-a02fed1e9a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:57.928543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1031/2055] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:57.991396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1025/2056] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:58.005816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e4624-6a7d-4de6-99d7-684c3e0f1e6e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:58.007295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d75e4624-6a7d-4de6-99d7-684c3e0f1e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:58.105955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e4624-6a7d-4de6-99d7-684c3e0f1e6e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:58.204489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52bf39-0c6c-43a0-b0f4-d26a1ec06a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:58.205154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52bf39-0c6c-43a0-b0f4-d26a1ec06a61 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:58.205471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52bf39-0c6c-43a0-b0f4-d26a1ec06a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:58.205759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52bf39-0c6c-43a0-b0f4-d26a1ec06a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:58.234690 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52bf39-0c6c-43a0-b0f4-d26a1ec06a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:58.237050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52bf39-0c6c-43a0-b0f4-d26a1ec06a61 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:58.252841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1032/2057] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:58.309708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5997545-edff-4eff-99ca-a02fed1e9a98 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:58.311467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b5997545-edff-4eff-99ca-a02fed1e9a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:58.330405 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5997545-edff-4eff-99ca-a02fed1e9a98 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:58.335738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:58.336346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:58.336679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:58.336957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] PATH_INFO: `/v3/projects/a26bdca6319a4fa2aaceb6eb2a4934c5` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:58.338304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26bdca6319a4fa2aaceb6eb2a4934c5)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:58.340510 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:58.441359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26bdca6319a4fa2aaceb6eb2a4934c5', 'request_id': 'req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:58.448759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26bdca6319a4fa2aaceb6eb2a4934c5', 'request_id': 'req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:58.461253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26bdca6319a4fa2aaceb6eb2a4934c5', 'request_id': 'req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:58.522714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] The token cache is being invalidate because project a26bdca6319a4fa2aaceb6eb2a4934c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:23:58.523025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:58.523674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-1ee1ee87-2f45-48af-9578-9ea78e4ce57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:23:58.525597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1026/2058] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:23:58 2022] DELETE /identity/v3/projects/a26bdca6319a4fa2aaceb6eb2a4934c5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:58.530845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefe13e-10a3-4bd3-8c8d-7cf12fc2af0d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:58.531368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefe13e-10a3-4bd3-8c8d-7cf12fc2af0d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:58.531797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefe13e-10a3-4bd3-8c8d-7cf12fc2af0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:58.554852 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3cefe13e-10a3-4bd3-8c8d-7cf12fc2af0d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:58.556117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3cefe13e-10a3-4bd3-8c8d-7cf12fc2af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:58.622337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1033/2059] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:58.631064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343985-0352-4a56-8b7c-f66d4c9776f4 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:58.631348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343985-0352-4a56-8b7c-f66d4c9776f4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:58.631664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343985-0352-4a56-8b7c-f66d4c9776f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:58.659466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-44343985-0352-4a56-8b7c-f66d4c9776f4 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:58.661001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-44343985-0352-4a56-8b7c-f66d4c9776f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:58.695113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1027/2060] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:23:58.699318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefe13e-10a3-4bd3-8c8d-7cf12fc2af0d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:58.714853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefe13e-10a3-4bd3-8c8d-7cf12fc2af0d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:58.720540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3378740-26c9-4c0c-969a-14e6045482a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:58.723838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3378740-26c9-4c0c-969a-14e6045482a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:58.723838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3378740-26c9-4c0c-969a-14e6045482a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:58.723838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3378740-26c9-4c0c-969a-14e6045482a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:58.723838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3378740-26c9-4c0c-969a-14e6045482a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:23:58.723838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3378740-26c9-4c0c-969a-14e6045482a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:58.724342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3378740-26c9-4c0c-969a-14e6045482a2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:58.745548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343985-0352-4a56-8b7c-f66d4c9776f4 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:58.750477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1034/2061] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:23:58.757628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343985-0352-4a56-8b7c-f66d4c9776f4 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:58.762581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c863-6eae-4029-868e-3d71ee3ba797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:58.763417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c863-6eae-4029-868e-3d71ee3ba797 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:58.763735 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c863-6eae-4029-868e-3d71ee3ba797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:58.769834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c863-6eae-4029-868e-3d71ee3ba797 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:58.769834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1c863-6eae-4029-868e-3d71ee3ba797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:58.769834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1c863-6eae-4029-868e-3d71ee3ba797 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:58.827628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7fb7-cde7-48bf-8d55-abf82ce7fe9f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:58.827978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7fb7-cde7-48bf-8d55-abf82ce7fe9f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:58.828260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7fb7-cde7-48bf-8d55-abf82ce7fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:58.860488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f81d7fb7-cde7-48bf-8d55-abf82ce7fe9f None None] MFA Rules not processed for user `bed04af5d690480e9739f3d87cabfadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:58.861717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f81d7fb7-cde7-48bf-8d55-abf82ce7fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:58.939158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1028/2062] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:58 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:58.943380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c863-6eae-4029-868e-3d71ee3ba797 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:58.946225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1035/2063] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:58.962227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0e91-0ff6-4959-9a3a-12f8919034bf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:58.962227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0e91-0ff6-4959-9a3a-12f8919034bf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:58.962227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0e91-0ff6-4959-9a3a-12f8919034bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:58.990241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-877a0e91-0ff6-4959-9a3a-12f8919034bf None None] MFA Rules not processed for user `bed04af5d690480e9739f3d87cabfadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:58.991760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-877a0e91-0ff6-4959-9a3a-12f8919034bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:59.039668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c863-6eae-4029-868e-3d71ee3ba797 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:59.050471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc2317-d448-4c8d-a5aa-a77b3cd12732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:59.052693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc2317-d448-4c8d-a5aa-a77b3cd12732 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:59.053953 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc2317-d448-4c8d-a5aa-a77b3cd12732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:59.054239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc2317-d448-4c8d-a5aa-a77b3cd12732 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:59.056396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc2317-d448-4c8d-a5aa-a77b3cd12732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:59.060669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc2317-d448-4c8d-a5aa-a77b3cd12732 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:59.087107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1036/2064] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:59.101500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0e91-0ff6-4959-9a3a-12f8919034bf None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:59.102898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-877a0e91-0ff6-4959-9a3a-12f8919034bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:59.171320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:59.192561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0e91-0ff6-4959-9a3a-12f8919034bf None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:59.199182 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c118d9c-5680-4145-9378-bad7fbcf6c61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:59.199812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118d9c-5680-4145-9378-bad7fbcf6c61 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:59.200092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118d9c-5680-4145-9378-bad7fbcf6c61 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:59.200407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c118d9c-5680-4145-9378-bad7fbcf6c61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:59.209856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c118d9c-5680-4145-9378-bad7fbcf6c61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:59.211478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c118d9c-5680-4145-9378-bad7fbcf6c61 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:59.222863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1037/2065] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:23:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:23:59.250393 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1029/2066] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:58 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:23:59.261878 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c118d9c-5680-4145-9378-bad7fbcf6c61 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:59.276655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c118d9c-5680-4145-9378-bad7fbcf6c61 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:59.282702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85aa67-454b-4dbf-9915-fe3abfaedc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:59.283505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85aa67-454b-4dbf-9915-fe3abfaedc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:59.283618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85aa67-454b-4dbf-9915-fe3abfaedc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:59.283861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85aa67-454b-4dbf-9915-fe3abfaedc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:59.284568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85aa67-454b-4dbf-9915-fe3abfaedc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:59.286156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85aa67-454b-4dbf-9915-fe3abfaedc8f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:59.320727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc2317-d448-4c8d-a5aa-a77b3cd12732 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:59.336473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1038/2067] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:59.342123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:59.347303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc2317-d448-4c8d-a5aa-a77b3cd12732 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:59.354488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cf93f-8145-424b-8163-1e2e4cad2a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:59.355493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf93f-8145-424b-8163-1e2e4cad2a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:59.355995 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf93f-8145-424b-8163-1e2e4cad2a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:59.356494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cf93f-8145-424b-8163-1e2e4cad2a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:59.358241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cf93f-8145-424b-8163-1e2e4cad2a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:59.360435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cf93f-8145-424b-8163-1e2e4cad2a5d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:59.374802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1030/2068] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:23:59.379981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85aa67-454b-4dbf-9915-fe3abfaedc8f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:59.407781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85aa67-454b-4dbf-9915-fe3abfaedc8f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:59.424456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd6918-3e81-4b36-ae3f-43035b2f2a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:59.424456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd6918-3e81-4b36-ae3f-43035b2f2a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:59.424456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd6918-3e81-4b36-ae3f-43035b2f2a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:59.424456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd6918-3e81-4b36-ae3f-43035b2f2a25 admin admin] PATH_INFO: `/v3/projects/3422d312ac2645cd94a33d1876764db1/users/09b08c3109164e4090928abe99e29ea3/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:59.440970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd6918-3e81-4b36-ae3f-43035b2f2a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3422d312ac2645cd94a33d1876764db1, user_id=09b08c3109164e4090928abe99e29ea3, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:59.449597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd6918-3e81-4b36-ae3f-43035b2f2a25 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:59.571165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1039/2069] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:23:59 2022] PUT /identity/v3/projects/3422d312ac2645cd94a33d1876764db1/users/09b08c3109164e4090928abe99e29ea3/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:23:59.586381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fcc64-faa3-4d22-88cf-d94956b7cb79 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:59.586675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fcc64-faa3-4d22-88cf-d94956b7cb79 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:59.586987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fcc64-faa3-4d22-88cf-d94956b7cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:59.638388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-be4fcc64-faa3-4d22-88cf-d94956b7cb79 None None] MFA Rules not processed for user `09b08c3109164e4090928abe99e29ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:23:59.641126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-be4fcc64-faa3-4d22-88cf-d94956b7cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:23:59.745955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1031/2070] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:23:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:23:59.750948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd6918-3e81-4b36-ae3f-43035b2f2a25 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:59.826469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd6918-3e81-4b36-ae3f-43035b2f2a25 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:23:59.839467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee6e16-8f27-434f-84cb-6ea21049b48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:23:59.840203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee6e16-8f27-434f-84cb-6ea21049b48e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:23:59.840608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee6e16-8f27-434f-84cb-6ea21049b48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:23:59.840993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee6e16-8f27-434f-84cb-6ea21049b48e admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:23:59.841749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee6e16-8f27-434f-84cb-6ea21049b48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:23:59.845402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee6e16-8f27-434f-84cb-6ea21049b48e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:23:59.962425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1040/2071] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:23:59 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:23:59.967188 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fcc64-faa3-4d22-88cf-d94956b7cb79 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:23:59.984474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fcc64-faa3-4d22-88cf-d94956b7cb79 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:00.054000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc381fa-6c0d-4a16-8c07-183afc9257a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:00.055232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc381fa-6c0d-4a16-8c07-183afc9257a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.055740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc381fa-6c0d-4a16-8c07-183afc9257a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.059503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc381fa-6c0d-4a16-8c07-183afc9257a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.059503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc381fa-6c0d-4a16-8c07-183afc9257a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:00.059503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc381fa-6c0d-4a16-8c07-183afc9257a6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:00.153211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1032/2072] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:23:59 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:24:00.153895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee6e16-8f27-434f-84cb-6ea21049b48e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:00.166107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee6e16-8f27-434f-84cb-6ea21049b48e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:00.174565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae37da-a78a-48ff-832e-14bb0069ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:00.175594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae37da-a78a-48ff-832e-14bb0069ec7f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.176118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae37da-a78a-48ff-832e-14bb0069ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.176885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae37da-a78a-48ff-832e-14bb0069ec7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.180068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae37da-a78a-48ff-832e-14bb0069ec7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:00.180068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae37da-a78a-48ff-832e-14bb0069ec7f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:00.196724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1041/2073] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:24:00.201343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc381fa-6c0d-4a16-8c07-183afc9257a6 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:00.215691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc381fa-6c0d-4a16-8c07-183afc9257a6 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:00.222957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8588dea-440c-4673-97fa-07980578eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:00.223571 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588dea-440c-4673-97fa-07980578eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.223848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588dea-440c-4673-97fa-07980578eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.224117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588dea-440c-4673-97fa-07980578eeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.224806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8588dea-440c-4673-97fa-07980578eeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:00.226440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8588dea-440c-4673-97fa-07980578eeb8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:00.240795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1033/2074] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:00.244666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae37da-a78a-48ff-832e-14bb0069ec7f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:00.262480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae37da-a78a-48ff-832e-14bb0069ec7f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:00.267063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6ba0-11fe-4ac2-bf29-810946225539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:00.268386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6ba0-11fe-4ac2-bf29-810946225539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.268883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6ba0-11fe-4ac2-bf29-810946225539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.270192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6ba0-11fe-4ac2-bf29-810946225539 admin admin] PATH_INFO: `/v3/projects/5c99b26fe7234ac8b57e5016cf26ba0d/users/8c647efdf4b047428a8016d22a9f969e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.287145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6ba0-11fe-4ac2-bf29-810946225539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c99b26fe7234ac8b57e5016cf26ba0d, user_id=8c647efdf4b047428a8016d22a9f969e, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:00.290587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6ba0-11fe-4ac2-bf29-810946225539 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:00.359454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b16b8a-d1f7-4250-b167-49541949eeb8 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.359743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b16b8a-d1f7-4250-b167-49541949eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.360025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b16b8a-d1f7-4250-b167-49541949eeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.384975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-60b16b8a-d1f7-4250-b167-49541949eeb8 None None] MFA Rules not processed for user `bed04af5d690480e9739f3d87cabfadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:00.386577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-60b16b8a-d1f7-4250-b167-49541949eeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:00.388536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1042/2075] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:00 2022] PUT /identity/v3/projects/5c99b26fe7234ac8b57e5016cf26ba0d/users/8c647efdf4b047428a8016d22a9f969e/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:00.401180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47654d-7508-4dfe-8eb4-fffed3defe29 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.402127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47654d-7508-4dfe-8eb4-fffed3defe29 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.402576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47654d-7508-4dfe-8eb4-fffed3defe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.457828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3c47654d-7508-4dfe-8eb4-fffed3defe29 None None] MFA Rules not processed for user `8c647efdf4b047428a8016d22a9f969e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:00.464950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3c47654d-7508-4dfe-8eb4-fffed3defe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:00.516525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1034/2076] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:24:00.518596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aebb8c-9172-40e6-96cf-17ffe66f2387 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.530562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aebb8c-9172-40e6-96cf-17ffe66f2387 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.530562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aebb8c-9172-40e6-96cf-17ffe66f2387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.584033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f7aebb8c-9172-40e6-96cf-17ffe66f2387 None None] MFA Rules not processed for user `5c08ce5eb5384347bfc4610931102cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:00.585505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f7aebb8c-9172-40e6-96cf-17ffe66f2387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:00.596937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1043/2077] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:24:00.601929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47654d-7508-4dfe-8eb4-fffed3defe29 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:00.722120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1035/2078] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:00.736799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aebb8c-9172-40e6-96cf-17ffe66f2387 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:00.738418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f7aebb8c-9172-40e6-96cf-17ffe66f2387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:00.781085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47654d-7508-4dfe-8eb4-fffed3defe29 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:00.786777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:00.787110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.787812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.788084 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.788750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:00.792420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:00.866227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aebb8c-9172-40e6-96cf-17ffe66f2387 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:00.871762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67385d4d-c360-49fd-a9c6-844a072b2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:00.872500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67385d4d-c360-49fd-a9c6-844a072b2bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:00.872778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67385d4d-c360-49fd-a9c6-844a072b2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:00.873052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67385d4d-c360-49fd-a9c6-844a072b2bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:00.874439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67385d4d-c360-49fd-a9c6-844a072b2bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:00.876453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67385d4d-c360-49fd-a9c6-844a072b2bfa admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:00.943703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1044/2079] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:24:00 2022] POST /identity/v3/projects => generated 375 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:24:00.943703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:00.944651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:01.017930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1036/2080] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:24:00 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:24:01.018905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67385d4d-c360-49fd-a9c6-844a072b2bfa admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.040635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7430a-3bf4-459d-909a-026a9cd2c606 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.111590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67385d4d-c360-49fd-a9c6-844a072b2bfa admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.119901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337455b4-a055-45a6-bb52-93c45eebb368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.120770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337455b4-a055-45a6-bb52-93c45eebb368 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.121074 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337455b4-a055-45a6-bb52-93c45eebb368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.121344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337455b4-a055-45a6-bb52-93c45eebb368 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.121982 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337455b4-a055-45a6-bb52-93c45eebb368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.125382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337455b4-a055-45a6-bb52-93c45eebb368 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:01.162360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.163101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.163456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.163804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] PATH_INFO: `/v3/users/badf51d0b0f646ddada871057a6feb2d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.165185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] RBAC: Authorizing `identity:delete_user(user_id=badf51d0b0f646ddada871057a6feb2d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.167314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:01.223106 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1037/2081] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:24:01 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:24:01.226887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337455b4-a055-45a6-bb52-93c45eebb368 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.254037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337455b4-a055-45a6-bb52-93c45eebb368 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.263081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.264199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.265723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.266230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.267719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.272023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:01.362588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'badf51d0b0f646ddada871057a6feb2d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:01.363424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'badf51d0b0f646ddada871057a6feb2d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:01.400841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1038/2082] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:24:01 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:24:01.400841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.402767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:01.419403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d7cc4-a636-4d4f-a931-de971dab01d9 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.427003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.427646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.428046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.428727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.429220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.431101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:01.434701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'badf51d0b0f646ddada871057a6feb2d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:01.446859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1039/2083] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:01.446859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.446859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:01.453234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'badf51d0b0f646ddada871057a6feb2d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:01.472881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94d43b-f88f-4657-9f90-c2ff06ccb835 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.477294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'badf51d0b0f646ddada871057a6feb2d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:01.484026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb59e8-d212-4e2a-944e-0a0977ed3bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.484798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb59e8-d212-4e2a-944e-0a0977ed3bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.485183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb59e8-d212-4e2a-944e-0a0977ed3bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.485556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb59e8-d212-4e2a-944e-0a0977ed3bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.486327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb59e8-d212-4e2a-944e-0a0977ed3bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.492217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1045/2084] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:24:00 2022] DELETE /identity/v3/users/badf51d0b0f646ddada871057a6feb2d => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:01.493980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.498397 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb59e8-d212-4e2a-944e-0a0977ed3bd2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:01.519608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:01.530626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1040/2085] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:01.532005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a488d1-625f-4260-a1ad-62db7011d4ab None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.532376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a488d1-625f-4260-a1ad-62db7011d4ab None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.533099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a488d1-625f-4260-a1ad-62db7011d4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.566206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-81a488d1-625f-4260-a1ad-62db7011d4ab None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:01.567542 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-81a488d1-625f-4260-a1ad-62db7011d4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:01.629369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb2dfc-f14f-4bad-b285-b68bad55925d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.639189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.640100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.640599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.641029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] PATH_INFO: `/v3/projects/4a1a04e1768a4932a8ef2f1387cbaeda/users/042c97d174ba404db3f2f0c7f18edf56/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.667183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1a04e1768a4932a8ef2f1387cbaeda, user_id=042c97d174ba404db3f2f0c7f18edf56, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.671281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:01.680246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:01.685302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1041/2086] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:01.687138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a488d1-625f-4260-a1ad-62db7011d4ab None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.707228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a488d1-625f-4260-a1ad-62db7011d4ab None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.710947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e855af-7244-46c5-82ea-5d53bbaade41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.711629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e855af-7244-46c5-82ea-5d53bbaade41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.711900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e855af-7244-46c5-82ea-5d53bbaade41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.712176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e855af-7244-46c5-82ea-5d53bbaade41 admin admin] PATH_INFO: `/v3/projects/536581e604fd4a0e9ecdbd612b34a563/users/e3c6b5eeac4749039c715cb473a9afb1/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.725760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1046/2087] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:01 2022] PUT /identity/v3/projects/4a1a04e1768a4932a8ef2f1387cbaeda/users/042c97d174ba404db3f2f0c7f18edf56/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:01.726803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.731954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:01.749436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e855af-7244-46c5-82ea-5d53bbaade41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536581e604fd4a0e9ecdbd612b34a563, user_id=e3c6b5eeac4749039c715cb473a9afb1, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.752903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e855af-7244-46c5-82ea-5d53bbaade41 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:01.838344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809a49e-f47d-4aa4-9589-6787aaa0bd92 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.838557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1042/2088] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:01 2022] PUT /identity/v3/projects/536581e604fd4a0e9ecdbd612b34a563/users/e3c6b5eeac4749039c715cb473a9afb1/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:01.839802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e855af-7244-46c5-82ea-5d53bbaade41 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.927137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37680-1fe2-4f66-ac41-4cec29124416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.929328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37680-1fe2-4f66-ac41-4cec29124416 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.929328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37680-1fe2-4f66-ac41-4cec29124416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.929328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37680-1fe2-4f66-ac41-4cec29124416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.944251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e855af-7244-46c5-82ea-5d53bbaade41 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.950126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de1146-e5ce-4123-b1f6-95c7984902ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.951131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de1146-e5ce-4123-b1f6-95c7984902ca admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.951564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de1146-e5ce-4123-b1f6-95c7984902ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.952579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de1146-e5ce-4123-b1f6-95c7984902ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.953339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de1146-e5ce-4123-b1f6-95c7984902ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.955013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de1146-e5ce-4123-b1f6-95c7984902ca admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:01.967150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1043/2089] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:01.968881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de1146-e5ce-4123-b1f6-95c7984902ca admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:01.979590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de1146-e5ce-4123-b1f6-95c7984902ca admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:01.985159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b154f0-509d-497e-8341-309e9f543988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:01.985558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b154f0-509d-497e-8341-309e9f543988 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:01.986061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b154f0-509d-497e-8341-309e9f543988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:01.986406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b154f0-509d-497e-8341-309e9f543988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:01.987135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b154f0-509d-497e-8341-309e9f543988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:01.988991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b154f0-509d-497e-8341-309e9f543988 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:02.008898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1044/2090] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:02.011084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b154f0-509d-497e-8341-309e9f543988 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:02.026842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c37680-1fe2-4f66-ac41-4cec29124416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:02.028996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b154f0-509d-497e-8341-309e9f543988 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:02.029377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c37680-1fe2-4f66-ac41-4cec29124416 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:02.034116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a830f4-1254-4025-b050-26f254c7b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:02.034939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a830f4-1254-4025-b050-26f254c7b0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:02.035383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a830f4-1254-4025-b050-26f254c7b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:02.036272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a830f4-1254-4025-b050-26f254c7b0ab admin admin] PATH_INFO: `/v3/projects/4a1a04e1768a4932a8ef2f1387cbaeda/users/042c97d174ba404db3f2f0c7f18edf56/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:02.038549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a830f4-1254-4025-b050-26f254c7b0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1a04e1768a4932a8ef2f1387cbaeda, user_id=042c97d174ba404db3f2f0c7f18edf56, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:02.040905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1047/2091] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:24:02.041429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a830f4-1254-4025-b050-26f254c7b0ab admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:02.045984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37680-1fe2-4f66-ac41-4cec29124416 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:02.059280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37680-1fe2-4f66-ac41-4cec29124416 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:02.065076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1045/2092] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:02 2022] PUT /identity/v3/projects/4a1a04e1768a4932a8ef2f1387cbaeda/users/042c97d174ba404db3f2f0c7f18edf56/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:02.086154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756b98-749c-47bc-9821-dead573970fc None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:02.091192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756b98-749c-47bc-9821-dead573970fc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:02.091192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef756b98-749c-47bc-9821-dead573970fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:02.146468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ef756b98-749c-47bc-9821-dead573970fc None None] MFA Rules not processed for user `042c97d174ba404db3f2f0c7f18edf56`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:02.147899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ef756b98-749c-47bc-9821-dead573970fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:02.195200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:02.195930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:02.196257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:02.197074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] PATH_INFO: `/v3/projects/536581e604fd4a0e9ecdbd612b34a563/users/e3c6b5eeac4749039c715cb473a9afb1/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:02.199862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=536581e604fd4a0e9ecdbd612b34a563, user_id=e3c6b5eeac4749039c715cb473a9afb1, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:02.202750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:02.214104 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1048/2093] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:02 2022] PUT /identity/v3/projects/536581e604fd4a0e9ecdbd612b34a563/users/e3c6b5eeac4749039c715cb473a9afb1/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:02.253742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1046/2094] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:02.269489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:02.271690 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:02.357475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129daa-018e-4048-a787-7d16e217ce9f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:02.367961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a255e7-2882-48f3-9fc0-c48e404d7176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:02.368773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a255e7-2882-48f3-9fc0-c48e404d7176 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:02.369641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a255e7-2882-48f3-9fc0-c48e404d7176 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:02.369641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a255e7-2882-48f3-9fc0-c48e404d7176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:02.371552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d1a255e7-2882-48f3-9fc0-c48e404d7176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:02.446026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a255e7-2882-48f3-9fc0-c48e404d7176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:02.447875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a255e7-2882-48f3-9fc0-c48e404d7176 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:02.463689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1049/2095] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:24:02.796412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef756b98-749c-47bc-9821-dead573970fc None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:02.798056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ef756b98-749c-47bc-9821-dead573970fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:02.814683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef756b98-749c-47bc-9821-dead573970fc None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:02.950302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:02.952624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:02.953958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:02.954472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] PATH_INFO: `/v3/projects/852f8755f8cd4d0ab0ed1213440f63c1` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:02.958757 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=852f8755f8cd4d0ab0ed1213440f63c1)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:02.962658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:03.178250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852f8755f8cd4d0ab0ed1213440f63c1', 'request_id': 'req-63738d32-e547-4eb5-8b1b-a7a06f9756ab'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:03.188990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852f8755f8cd4d0ab0ed1213440f63c1', 'request_id': 'req-63738d32-e547-4eb5-8b1b-a7a06f9756ab'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:03.200519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852f8755f8cd4d0ab0ed1213440f63c1', 'request_id': 'req-63738d32-e547-4eb5-8b1b-a7a06f9756ab'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:03.305531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] The token cache is being invalidate because project 852f8755f8cd4d0ab0ed1213440f63c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:24:03.306347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:03.307427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-63738d32-e547-4eb5-8b1b-a7a06f9756ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:03.311603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1047/2096] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:24:02 2022] DELETE /identity/v3/projects/852f8755f8cd4d0ab0ed1213440f63c1 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:03.317465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4b38-3b79-4915-a78c-d2fcd7e685f0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:03.317876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4b38-3b79-4915-a78c-d2fcd7e685f0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:03.318013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4b38-3b79-4915-a78c-d2fcd7e685f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:03.365509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-443f4b38-3b79-4915-a78c-d2fcd7e685f0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:03.369244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-443f4b38-3b79-4915-a78c-d2fcd7e685f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:03.465380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1050/2097] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:24:03.469402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69730cc-10b7-4fcc-bfbd-e15b954d5cc9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:03.470005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69730cc-10b7-4fcc-bfbd-e15b954d5cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:03.470739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69730cc-10b7-4fcc-bfbd-e15b954d5cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:03.509428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e69730cc-10b7-4fcc-bfbd-e15b954d5cc9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:03.510844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e69730cc-10b7-4fcc-bfbd-e15b954d5cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:03.534175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1048/2098] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:03.535160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4b38-3b79-4915-a78c-d2fcd7e685f0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:03.556457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4b38-3b79-4915-a78c-d2fcd7e685f0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:03.563223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:03.564275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:03.564768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:03.565357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:03.566347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:24:03.567006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:03.568869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:03.588184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1051/2099] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:24:03.593047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69730cc-10b7-4fcc-bfbd-e15b954d5cc9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:03.609481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69730cc-10b7-4fcc-bfbd-e15b954d5cc9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:03.621376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad2d79-f9d0-495f-9a15-58544e479371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:03.622444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad2d79-f9d0-495f-9a15-58544e479371 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:03.622725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad2d79-f9d0-495f-9a15-58544e479371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:03.623001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad2d79-f9d0-495f-9a15-58544e479371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:03.628417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad2d79-f9d0-495f-9a15-58544e479371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:03.628417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad2d79-f9d0-495f-9a15-58544e479371 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:03.744383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1049/2100] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:24:03 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:24:03.745046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:03.758826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700ae33-31d6-4396-8196-661db5a0b1f3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:03.805676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:03.945192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6dad0-2ae3-459e-9680-448ecc2dd82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:03.945192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6dad0-2ae3-459e-9680-448ecc2dd82d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:03.945192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6dad0-2ae3-459e-9680-448ecc2dd82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:03.945192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6dad0-2ae3-459e-9680-448ecc2dd82d admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:03.945601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6dad0-2ae3-459e-9680-448ecc2dd82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:03.945601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6dad0-2ae3-459e-9680-448ecc2dd82d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:04.050791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:04.053167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1052/2101] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:24:03 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:24:04.057161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad2d79-f9d0-495f-9a15-58544e479371 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:04.068553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad2d79-f9d0-495f-9a15-58544e479371 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:04.075765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2242af-ec35-4867-a761-d88dd0468065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:04.075765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2242af-ec35-4867-a761-d88dd0468065 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.075765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2242af-ec35-4867-a761-d88dd0468065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.075765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2242af-ec35-4867-a761-d88dd0468065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.076125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2242af-ec35-4867-a761-d88dd0468065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:04.078296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2242af-ec35-4867-a761-d88dd0468065 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:04.089604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1050/2102] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:04.093552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6dad0-2ae3-459e-9680-448ecc2dd82d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:04.103706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6dad0-2ae3-459e-9680-448ecc2dd82d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:04.108975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd19aa1-d430-4c68-884f-2515c18f80b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:04.109593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19aa1-d430-4c68-884f-2515c18f80b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.109870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19aa1-d430-4c68-884f-2515c18f80b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.110142 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19aa1-d430-4c68-884f-2515c18f80b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.110904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd19aa1-d430-4c68-884f-2515c18f80b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:04.112518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd19aa1-d430-4c68-884f-2515c18f80b3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:04.125548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1053/2103] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:04.131148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2242af-ec35-4867-a761-d88dd0468065 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:04.141606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2242af-ec35-4867-a761-d88dd0468065 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:04.146562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8de3c-700c-42f5-806f-4f397d83f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:04.147206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8de3c-700c-42f5-806f-4f397d83f0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.148130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8de3c-700c-42f5-806f-4f397d83f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.148130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8de3c-700c-42f5-806f-4f397d83f0a7 admin admin] PATH_INFO: `/v3/projects/af1f7aa5085a4d6698e40725be9e46b3/users/a5bfdee7f3214a2d893bdfd5cdf210f8/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.164597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8de3c-700c-42f5-806f-4f397d83f0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1f7aa5085a4d6698e40725be9e46b3, user_id=a5bfdee7f3214a2d893bdfd5cdf210f8, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:04.167377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8de3c-700c-42f5-806f-4f397d83f0a7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:04.235040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1051/2104] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:04 2022] PUT /identity/v3/projects/af1f7aa5085a4d6698e40725be9e46b3/users/a5bfdee7f3214a2d893bdfd5cdf210f8/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:24:04.240062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee9137-50e3-454e-b733-2cd0917901d1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.240386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee9137-50e3-454e-b733-2cd0917901d1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.240663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee9137-50e3-454e-b733-2cd0917901d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.316771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e8f3-db58-42d0-ae36-acf92ac2886d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.316771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e8f3-db58-42d0-ae36-acf92ac2886d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.316771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e8f3-db58-42d0-ae36-acf92ac2886d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.318232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-53ee9137-50e3-454e-b733-2cd0917901d1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:04.318232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-53ee9137-50e3-454e-b733-2cd0917901d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:04.323521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-6fc2e8f3-db58-42d0-ae36-acf92ac2886d None None] MFA Rules not processed for user `e3c6b5eeac4749039c715cb473a9afb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:04.325039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6fc2e8f3-db58-42d0-ae36-acf92ac2886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:04.376941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1054/2105] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:04.383141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee9137-50e3-454e-b733-2cd0917901d1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:04.384970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-53ee9137-50e3-454e-b733-2cd0917901d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:04.484080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1052/2106] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:24:04.496838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c52f-f72d-4f38-9b5f-d2d547654244 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.502274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c52f-f72d-4f38-9b5f-d2d547654244 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.502274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98c52f-f72d-4f38-9b5f-d2d547654244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.512722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee9137-50e3-454e-b733-2cd0917901d1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:04.523355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:04.524138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.524552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.524930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.535950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ae98c52f-f72d-4f38-9b5f-d2d547654244 None None] MFA Rules not processed for user `5c08ce5eb5384347bfc4610931102cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:04.536302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:04.536869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ae98c52f-f72d-4f38-9b5f-d2d547654244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:04.537995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:04.549952 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1055/2107] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:24:04.575102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:04.655500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1053/2108] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:04.661692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:04.663197 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:04.781459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98c52f-f72d-4f38-9b5f-d2d547654244 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:04.782889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ae98c52f-f72d-4f38-9b5f-d2d547654244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:04.835140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f9239-831a-4b8d-9372-d0794d5b5e7f service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:04.843767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:04.844427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.844712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.845042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.848724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:04.863289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:04.865226 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:04.877019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1056/2109] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:24:04.899930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98c52f-f72d-4f38-9b5f-d2d547654244 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:04.905192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:04.906090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:04.906560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:04.907000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:04.909728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:04.984970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:04.986652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:05.001350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1054/2110] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:24:05.113042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:05.325780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:06.009758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:06.369531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:06.962744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:06.973194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dce87-27cd-40a8-b115-96a088b7aaa2 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:06.977410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ffe98-702b-4de0-85b1-78ae4d66867e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:06.981170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ffe98-702b-4de0-85b1-78ae4d66867e service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:06.981170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ffe98-702b-4de0-85b1-78ae4d66867e service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:06.981170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ffe98-702b-4de0-85b1-78ae4d66867e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:06.981170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-393ffe98-702b-4de0-85b1-78ae4d66867e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:07.090002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ffe98-702b-4de0-85b1-78ae4d66867e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:07.094163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ffe98-702b-4de0-85b1-78ae4d66867e service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:07.107991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1057/2111] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:24:07.758772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:08.089580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:09.552600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:10.055092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:11.021120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:11.859169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:11.862386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:11.881951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a21f4f-f179-413a-985b-407e766b2a12 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:11.889345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:11.890229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:11.890590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:11.891923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] PATH_INFO: `/v3/users/09b08c3109164e4090928abe99e29ea3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:11.892853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b08c3109164e4090928abe99e29ea3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:11.895067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:12.129991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b08c3109164e4090928abe99e29ea3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:12.214774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b08c3109164e4090928abe99e29ea3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:12.215496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b08c3109164e4090928abe99e29ea3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:12.238423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b08c3109164e4090928abe99e29ea3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:12.240016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b08c3109164e4090928abe99e29ea3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:12.263768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1055/2112] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:24:11 2022] DELETE /identity/v3/users/09b08c3109164e4090928abe99e29ea3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:12.265828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a14bf-6f34-4f45-9436-69c6a85415ce None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:12.266282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a14bf-6f34-4f45-9436-69c6a85415ce None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:12.266413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a14bf-6f34-4f45-9436-69c6a85415ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:12.301121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f99a14bf-6f34-4f45-9436-69c6a85415ce None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:12.302848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f99a14bf-6f34-4f45-9436-69c6a85415ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:12.313513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:12.407624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1058/2113] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:12.417864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:12.420014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:12.521341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e7b8b-b886-42df-833f-cea3df97cabc admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:12.534853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2692c9-042e-4c4a-a6a0-c80e8e0e7630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:12.535502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2692c9-042e-4c4a-a6a0-c80e8e0e7630 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:12.535785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2692c9-042e-4c4a-a6a0-c80e8e0e7630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:12.536062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2692c9-042e-4c4a-a6a0-c80e8e0e7630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:12.547687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2692c9-042e-4c4a-a6a0-c80e8e0e7630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:12.549235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2692c9-042e-4c4a-a6a0-c80e8e0e7630 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:12.560653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1056/2114] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:24:13.535501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a14bf-6f34-4f45-9436-69c6a85415ce None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:13.537078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f99a14bf-6f34-4f45-9436-69c6a85415ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:13.554472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a14bf-6f34-4f45-9436-69c6a85415ce None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:13.564786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:13.566245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:13.566776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:13.567312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] PATH_INFO: `/v3/projects/3422d312ac2645cd94a33d1876764db1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:13.569414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3422d312ac2645cd94a33d1876764db1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:13.572098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:13.727627 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3422d312ac2645cd94a33d1876764db1', 'request_id': 'req-1a4f460f-7f79-402c-ad30-94cb9c554e7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:13.739089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3422d312ac2645cd94a33d1876764db1', 'request_id': 'req-1a4f460f-7f79-402c-ad30-94cb9c554e7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:13.745959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3422d312ac2645cd94a33d1876764db1', 'request_id': 'req-1a4f460f-7f79-402c-ad30-94cb9c554e7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:13.809402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd684e9-8dd4-4b03-b7da-8f39fb53a9cf None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:13.810031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd684e9-8dd4-4b03-b7da-8f39fb53a9cf None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:13.810031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd684e9-8dd4-4b03-b7da-8f39fb53a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:13.820862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:13.829308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] The token cache is being invalidate because project 3422d312ac2645cd94a33d1876764db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:24:13.832776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:13.832776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:13.832776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1059/2115] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:24:13 2022] DELETE /identity/v3/projects/3422d312ac2645cd94a33d1876764db1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:13.836073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:13.837932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:13.854453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-cbd684e9-8dd4-4b03-b7da-8f39fb53a9cf None None] MFA Rules not processed for user `a5bfdee7f3214a2d893bdfd5cdf210f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:13.855333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-cbd684e9-8dd4-4b03-b7da-8f39fb53a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:13.943533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f460f-7f79-402c-ad30-94cb9c554e7e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:13.951255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1057/2116] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:13.951877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:13.956593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd684e9-8dd4-4b03-b7da-8f39fb53a9cf None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:13.956837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:13.956837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:13.956837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] PATH_INFO: `/v3/users/8c647efdf4b047428a8016d22a9f969e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:13.957090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-cbd684e9-8dd4-4b03-b7da-8f39fb53a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:13.969404 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c647efdf4b047428a8016d22a9f969e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:13.971339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:13.981302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd684e9-8dd4-4b03-b7da-8f39fb53a9cf None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:13.989479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4f7e-3d4a-4274-be5a-af04180b1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:13.990253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4f7e-3d4a-4274-be5a-af04180b1b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:13.990891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4f7e-3d4a-4274-be5a-af04180b1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:13.991334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4f7e-3d4a-4274-be5a-af04180b1b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:13.991975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a4f7e-3d4a-4274-be5a-af04180b1b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:13.994086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a4f7e-3d4a-4274-be5a-af04180b1b98 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:14.108390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1058/2117] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:24:13 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:24:14.112453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4f7e-3d4a-4274-be5a-af04180b1b98 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:14.182060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4f7e-3d4a-4274-be5a-af04180b1b98 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:14.201809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:14.205663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73f790-7db3-4d31-8a4e-425719b51d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:14.206354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f790-7db3-4d31-8a4e-425719b51d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:14.206639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f790-7db3-4d31-8a4e-425719b51d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:14.207061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f790-7db3-4d31-8a4e-425719b51d86 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:14.207976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73f790-7db3-4d31-8a4e-425719b51d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:14.211771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73f790-7db3-4d31-8a4e-425719b51d86 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:14.215330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c647efdf4b047428a8016d22a9f969e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:14.217901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c647efdf4b047428a8016d22a9f969e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:14.283168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c647efdf4b047428a8016d22a9f969e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:14.291027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c647efdf4b047428a8016d22a9f969e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:14.303924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c647efdf4b047428a8016d22a9f969e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:14.314907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1060/2118] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:24:13 2022] DELETE /identity/v3/users/8c647efdf4b047428a8016d22a9f969e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:14.320673 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1059/2119] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:24:14 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:24:14.325953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:14.327511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:14.405737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16053bf7-5b76-4f0d-8269-852de6634f91 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:14.410665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a74213-4e74-4db8-841a-56d57785cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:14.411286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a74213-4e74-4db8-841a-56d57785cd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:14.411576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a74213-4e74-4db8-841a-56d57785cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:14.411853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a74213-4e74-4db8-841a-56d57785cd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:14.412542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a74213-4e74-4db8-841a-56d57785cd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:14.414320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a74213-4e74-4db8-841a-56d57785cd2e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:14.428856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1061/2120] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:14.429918 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73f790-7db3-4d31-8a4e-425719b51d86 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:14.440944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73f790-7db3-4d31-8a4e-425719b51d86 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:14.453382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f92a54-3a85-4bb1-9168-0f35c362a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:14.454169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f92a54-3a85-4bb1-9168-0f35c362a3de admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:14.458844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f92a54-3a85-4bb1-9168-0f35c362a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:14.469204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f92a54-3a85-4bb1-9168-0f35c362a3de admin admin] PATH_INFO: `/v3/projects/b10d977e29df452fa7531c0452ea2066/users/ea079f382b6f4afcb3fc5345ca9a2bb8/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:14.478716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f92a54-3a85-4bb1-9168-0f35c362a3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10d977e29df452fa7531c0452ea2066, user_id=ea079f382b6f4afcb3fc5345ca9a2bb8, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:14.481504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f92a54-3a85-4bb1-9168-0f35c362a3de admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:14.553138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1060/2121] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:14 2022] PUT /identity/v3/projects/b10d977e29df452fa7531c0452ea2066/users/ea079f382b6f4afcb3fc5345ca9a2bb8/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:14.557958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a74213-4e74-4db8-841a-56d57785cd2e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:14.574365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a74213-4e74-4db8-841a-56d57785cd2e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:14.673064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:14.673594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:14.673869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:14.674309 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:14.675976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:14.678192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:14.693028 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1062/2122] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:14.696755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f92a54-3a85-4bb1-9168-0f35c362a3de admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:14.713828 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f92a54-3a85-4bb1-9168-0f35c362a3de admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:14.725148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:14.725846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:14.727531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:14.727531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] PATH_INFO: `/v3/projects/b10d977e29df452fa7531c0452ea2066/users/ea079f382b6f4afcb3fc5345ca9a2bb8/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:14.730057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10d977e29df452fa7531c0452ea2066, user_id=ea079f382b6f4afcb3fc5345ca9a2bb8, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:14.738891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:14.758523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1061/2123] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:14 2022] PUT /identity/v3/projects/b10d977e29df452fa7531c0452ea2066/users/ea079f382b6f4afcb3fc5345ca9a2bb8/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:14.902647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:14.904666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:14.918917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7078561-d375-4849-98a1-31cddc20b5f9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:15.092135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:15.092928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:15.093211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:15.094963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] PATH_INFO: `/v3/projects/5c99b26fe7234ac8b57e5016cf26ba0d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:15.095430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c99b26fe7234ac8b57e5016cf26ba0d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:15.097522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:15.245539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c99b26fe7234ac8b57e5016cf26ba0d', 'request_id': 'req-6de4eb3d-5931-4ae8-a29a-3a357c665140'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.252239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c99b26fe7234ac8b57e5016cf26ba0d', 'request_id': 'req-6de4eb3d-5931-4ae8-a29a-3a357c665140'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.261259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c99b26fe7234ac8b57e5016cf26ba0d', 'request_id': 'req-6de4eb3d-5931-4ae8-a29a-3a357c665140'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.332081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] The token cache is being invalidate because project 5c99b26fe7234ac8b57e5016cf26ba0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:24:15.332448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.333876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.335953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1063/2124] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:24:14 2022] DELETE /identity/v3/projects/5c99b26fe7234ac8b57e5016cf26ba0d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:15.340394 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:15.343176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:15.378027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14bbd1-0971-4461-a70b-506162383e39 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:15.430354 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:15.500485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:15.501212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:15.501498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:15.501780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] PATH_INFO: `/v3/users/042c97d174ba404db3f2f0c7f18edf56` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:15.503038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042c97d174ba404db3f2f0c7f18edf56)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:15.505540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:15.586059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:15.799400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042c97d174ba404db3f2f0c7f18edf56'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.912615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042c97d174ba404db3f2f0c7f18edf56'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.914132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042c97d174ba404db3f2f0c7f18edf56'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.936344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042c97d174ba404db3f2f0c7f18edf56'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.939032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e24bcc8c-bd2b-4956-a0c2-47e0a46d31a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042c97d174ba404db3f2f0c7f18edf56'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:15.955132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1062/2125] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:24:15 2022] DELETE /identity/v3/users/042c97d174ba404db3f2f0c7f18edf56 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:16.864080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:16.894925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4eb3d-5931-4ae8-a29a-3a357c665140 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:16.997647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:16.998796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:16.999321 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:17.001654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] PATH_INFO: `/v3/projects/4a1a04e1768a4932a8ef2f1387cbaeda` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:17.003542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1a04e1768a4932a8ef2f1387cbaeda)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:17.006652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:17.134990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1a04e1768a4932a8ef2f1387cbaeda', 'request_id': 'req-85a0eb01-4a62-4594-b7ab-7282d7c72055'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:17.141744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1a04e1768a4932a8ef2f1387cbaeda', 'request_id': 'req-85a0eb01-4a62-4594-b7ab-7282d7c72055'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:17.151907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1a04e1768a4932a8ef2f1387cbaeda', 'request_id': 'req-85a0eb01-4a62-4594-b7ab-7282d7c72055'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:17.341105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] The token cache is being invalidate because project 4a1a04e1768a4932a8ef2f1387cbaeda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:24:17.341599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:17.342883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-85a0eb01-4a62-4594-b7ab-7282d7c72055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:24:17.344995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1064/2126] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:24:16 2022] DELETE /identity/v3/projects/4a1a04e1768a4932a8ef2f1387cbaeda => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:17.350199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f94f-d3c2-4786-8947-837566a44140 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:17.350824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f94f-d3c2-4786-8947-837566a44140 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:17.350824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f94f-d3c2-4786-8947-837566a44140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:17.376619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8b58f94f-d3c2-4786-8947-837566a44140 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:17.378040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8b58f94f-d3c2-4786-8947-837566a44140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:17.476597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1063/2127] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:17.484925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992fe5a-cfbf-4f60-b1fc-abfd821d15c1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:17.485417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992fe5a-cfbf-4f60-b1fc-abfd821d15c1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:17.485822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992fe5a-cfbf-4f60-b1fc-abfd821d15c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:17.510048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9992fe5a-cfbf-4f60-b1fc-abfd821d15c1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:17.511373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9992fe5a-cfbf-4f60-b1fc-abfd821d15c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:17.524140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1065/2128] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:24:17.529948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58f94f-d3c2-4786-8947-837566a44140 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:17.542470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58f94f-d3c2-4786-8947-837566a44140 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:17.545541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:17.546181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:17.546460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:17.546734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:17.547413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:24:17.547715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:17.549378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:17.563567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1064/2129] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:24:17.567795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992fe5a-cfbf-4f60-b1fc-abfd821d15c1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:17.580680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992fe5a-cfbf-4f60-b1fc-abfd821d15c1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:17.585465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337cb04-09d4-4475-b616-e3a39ba9d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:17.586754 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337cb04-09d4-4475-b616-e3a39ba9d3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:17.587055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337cb04-09d4-4475-b616-e3a39ba9d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:17.587334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337cb04-09d4-4475-b616-e3a39ba9d3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:17.587980 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337cb04-09d4-4475-b616-e3a39ba9d3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:17.615226 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337cb04-09d4-4475-b616-e3a39ba9d3d3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:17.756055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1066/2130] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:24:17 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:24:17.768485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:17.788762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be6db-b9a9-4b59-8f11-18014a478b8a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:17.885899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:17.930975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade888bc-6fe1-4a5f-9ca9-82885a86f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:17.931693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade888bc-6fe1-4a5f-9ca9-82885a86f52e admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:17.932045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade888bc-6fe1-4a5f-9ca9-82885a86f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:17.932417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade888bc-6fe1-4a5f-9ca9-82885a86f52e admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:17.933169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade888bc-6fe1-4a5f-9ca9-82885a86f52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:17.936031 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade888bc-6fe1-4a5f-9ca9-82885a86f52e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:18.000071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1065/2131] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:24:17 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:24:18.004417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337cb04-09d4-4475-b616-e3a39ba9d3d3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:18.021981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337cb04-09d4-4475-b616-e3a39ba9d3d3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:18.036097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedb38-ce26-46ca-986c-996c0b92ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:18.036834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedb38-ce26-46ca-986c-996c0b92ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:18.037375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedb38-ce26-46ca-986c-996c0b92ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:18.037704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedb38-ce26-46ca-986c-996c0b92ac19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:18.038378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeedb38-ce26-46ca-986c-996c0b92ac19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:18.040058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeedb38-ce26-46ca-986c-996c0b92ac19 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:18.061128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1067/2132] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:18.065258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade888bc-6fe1-4a5f-9ca9-82885a86f52e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:18.087808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade888bc-6fe1-4a5f-9ca9-82885a86f52e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:18.096863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54728-ef1f-40ad-8eaa-c0f4246262a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:18.096863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54728-ef1f-40ad-8eaa-c0f4246262a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:18.096863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54728-ef1f-40ad-8eaa-c0f4246262a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:18.096863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54728-ef1f-40ad-8eaa-c0f4246262a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:18.097334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b54728-ef1f-40ad-8eaa-c0f4246262a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:18.097415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b54728-ef1f-40ad-8eaa-c0f4246262a3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:18.112258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1066/2133] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:24:18.118107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedb38-ce26-46ca-986c-996c0b92ac19 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:18.129846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeedb38-ce26-46ca-986c-996c0b92ac19 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:18.137101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:18.137983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:18.138924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:18.138924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] PATH_INFO: `/v3/projects/6f08a72203844ed0b617bbc2ec85c5d5/users/91c4e4c7039a43129d9912ba4e69fbbd/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:18.160709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f08a72203844ed0b617bbc2ec85c5d5, user_id=91c4e4c7039a43129d9912ba4e69fbbd, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:18.165856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:18.267459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1068/2134] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:24:18 2022] PUT /identity/v3/projects/6f08a72203844ed0b617bbc2ec85c5d5/users/91c4e4c7039a43129d9912ba4e69fbbd/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:24:18.270723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e350f-c9ac-4e61-9cb8-24c1fd7d38ae None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:18.271358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e350f-c9ac-4e61-9cb8-24c1fd7d38ae None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:18.272054 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e350f-c9ac-4e61-9cb8-24c1fd7d38ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:18.314692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-707e350f-c9ac-4e61-9cb8-24c1fd7d38ae None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:18.316110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-707e350f-c9ac-4e61-9cb8-24c1fd7d38ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:18.334507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:18.394540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1067/2135] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:18.405961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:18.407890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:18.511305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ff437-a8e2-40c9-89b6-4104b6560e17 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:18.515741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:18.516694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:18.517411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:18.517876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:18.529301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:18.531115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:18.548531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1069/2136] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:24:20.680496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46da78-4eb5-4a75-8560-52d2128046d4 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:20.680996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46da78-4eb5-4a75-8560-52d2128046d4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:20.681221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46da78-4eb5-4a75-8560-52d2128046d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:20.716402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ff46da78-4eb5-4a75-8560-52d2128046d4 None None] MFA Rules not processed for user `91c4e4c7039a43129d9912ba4e69fbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:20.718632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ff46da78-4eb5-4a75-8560-52d2128046d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:20.831227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1068/2137] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:20.845222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:20.850615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:20.955334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a5f3c-c84d-4c11-b86c-c9d0d7c544aa service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:20.963722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:20.964542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:20.965250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:20.965797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:20.980685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:20.982818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:20.993763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1070/2138] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:24:22.334808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea24a3f-de66-4ab9-aa46-73e0d728f300 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:22.335345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea24a3f-de66-4ab9-aa46-73e0d728f300 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:22.335469 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea24a3f-de66-4ab9-aa46-73e0d728f300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:22.378126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-fea24a3f-de66-4ab9-aa46-73e0d728f300 None None] MFA Rules not processed for user `ea079f382b6f4afcb3fc5345ca9a2bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:22.379364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fea24a3f-de66-4ab9-aa46-73e0d728f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:22.417228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:22.491396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1069/2139] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:22.508327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:22.508327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:22.595560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:22.599783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fccbd4-47cb-4cac-a04a-95a1bbf05625 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:22.604420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc7327f524a450e8429b5008166e5d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:22.605185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:22.605473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:22.605919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:22.607757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:22.675641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:22.677415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:22.688923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1071/2140] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:24:23.053154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a37961-7efe-4bf6-9933-01c803ff89b4 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:23.053384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a37961-7efe-4bf6-9933-01c803ff89b4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:23.053838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a37961-7efe-4bf6-9933-01c803ff89b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:23.084099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-87a37961-7efe-4bf6-9933-01c803ff89b4 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:23.085921 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-87a37961-7efe-4bf6-9933-01c803ff89b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:23.167561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1070/2141] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:24:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:23.241693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:23.243395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:23.337997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360ddd9-ba02-4858-9312-1fcf3771e1d8 service glance] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:23.344652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:23.345281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:23.345640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:23.346193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:23.355303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:23.357429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:23.373843 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1072/2142] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:24.106821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c9af-f8ba-4e9d-b282-79cf6ed4e0c6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:24.106821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c9af-f8ba-4e9d-b282-79cf6ed4e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:24.108750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c9af-f8ba-4e9d-b282-79cf6ed4e0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:24.155616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-25e3c9af-f8ba-4e9d-b282-79cf6ed4e0c6 None None] MFA Rules not processed for user `91c4e4c7039a43129d9912ba4e69fbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:24.163740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-25e3c9af-f8ba-4e9d-b282-79cf6ed4e0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:24.192976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1071/2143] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:32.187645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:32.192294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:32.208515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8b51-2dc8-48e4-916b-c4877046da9e service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:32.213441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915329c-5aa5-46be-a5e7-00c8d83ce42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:32.214328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915329c-5aa5-46be-a5e7-00c8d83ce42f service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:32.215537 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915329c-5aa5-46be-a5e7-00c8d83ce42f service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:32.215973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915329c-5aa5-46be-a5e7-00c8d83ce42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:32.218064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c915329c-5aa5-46be-a5e7-00c8d83ce42f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:32.299856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915329c-5aa5-46be-a5e7-00c8d83ce42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:32.320582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915329c-5aa5-46be-a5e7-00c8d83ce42f service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:32.320582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1073/2144] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:24:32.614236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84545a9-7e59-48d8-aaba-30b621ff57c7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:32.615443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84545a9-7e59-48d8-aaba-30b621ff57c7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:32.615862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84545a9-7e59-48d8-aaba-30b621ff57c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:32.639373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d84545a9-7e59-48d8-aaba-30b621ff57c7 None None] MFA Rules not processed for user `732e7072abde49de887256b43707c0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:32.641212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d84545a9-7e59-48d8-aaba-30b621ff57c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:32.739408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1072/2145] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:37.372122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af843c4-67d5-4ea8-8916-44e852c15414 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:37.372808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af843c4-67d5-4ea8-8916-44e852c15414 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:37.372808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af843c4-67d5-4ea8-8916-44e852c15414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:37.395722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9af843c4-67d5-4ea8-8916-44e852c15414 None None] MFA Rules not processed for user `a5bfdee7f3214a2d893bdfd5cdf210f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:37.397211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9af843c4-67d5-4ea8-8916-44e852c15414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:37.405794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1074/2146] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:24:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:41.442978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4953b5-824f-4dc8-8594-b2418afb8e41 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:41.443949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4953b5-824f-4dc8-8594-b2418afb8e41 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:41.444408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4953b5-824f-4dc8-8594-b2418afb8e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:41.470019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-ee4953b5-824f-4dc8-8594-b2418afb8e41 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:41.471651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ee4953b5-824f-4dc8-8594-b2418afb8e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:41.486535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1073/2147] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:24:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:41.493964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af843c4-67d5-4ea8-8916-44e852c15414 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:41.508971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af843c4-67d5-4ea8-8916-44e852c15414 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:41.516373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05dab-8535-4031-b240-1fd2d5adbc5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:41.517132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05dab-8535-4031-b240-1fd2d5adbc5e service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:41.517416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05dab-8535-4031-b240-1fd2d5adbc5e service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:41.517691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05dab-8535-4031-b240-1fd2d5adbc5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:41.529603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a05dab-8535-4031-b240-1fd2d5adbc5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:41.531997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a05dab-8535-4031-b240-1fd2d5adbc5e service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:41.567525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1075/2148] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:24:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:43.060374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932eb4e-bd10-4797-bd0e-d0f58cea5ca6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:43.060884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932eb4e-bd10-4797-bd0e-d0f58cea5ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:43.060981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932eb4e-bd10-4797-bd0e-d0f58cea5ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:43.105115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-1932eb4e-bd10-4797-bd0e-d0f58cea5ca6 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:43.106789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1932eb4e-bd10-4797-bd0e-d0f58cea5ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:43.126425 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1074/2149] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:24:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:24:43.149242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05dab-8535-4031-b240-1fd2d5adbc5e service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:43.169504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05dab-8535-4031-b240-1fd2d5adbc5e service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:43.178855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:43.180078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:43.180766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:43.181052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:43.191856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:43.196221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:43.198118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:43.207564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1076/2150] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:24:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:43.831253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131574-eb00-4326-8b3e-8f29133d02a8 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:43.831583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131574-eb00-4326-8b3e-8f29133d02a8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:43.831882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131574-eb00-4326-8b3e-8f29133d02a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:43.912784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-02131574-eb00-4326-8b3e-8f29133d02a8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:43.915504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-02131574-eb00-4326-8b3e-8f29133d02a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:43.938096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1075/2151] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:44.137081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:44.138631 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:44.321208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5a2e-a59e-4a9a-a49e-1e01bf34603d service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:44.340166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57ba30-157a-4f8f-b559-b800d2e6c3da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:44.341117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ba30-157a-4f8f-b559-b800d2e6c3da service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:44.341460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ba30-157a-4f8f-b559-b800d2e6c3da service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:44.348048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ba30-157a-4f8f-b559-b800d2e6c3da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:44.371567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57ba30-157a-4f8f-b559-b800d2e6c3da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:44.379022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57ba30-157a-4f8f-b559-b800d2e6c3da service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:44.406385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1077/2152] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:24:53.904789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=79 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:54.394304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=37 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:55.942887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898efab5-b011-47e7-ab6c-c8943263c905 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:55.943864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898efab5-b011-47e7-ab6c-c8943263c905 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:55.944361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898efab5-b011-47e7-ab6c-c8943263c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:55.997558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-898efab5-b011-47e7-ab6c-c8943263c905 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:24:55.998929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-898efab5-b011-47e7-ab6c-c8943263c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:24:56.007377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1076/2153] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:24:56.056227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57ba30-157a-4f8f-b559-b800d2e6c3da service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:24:56.074437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57ba30-157a-4f8f-b559-b800d2e6c3da service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:24:56.080640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ef3fe-e41d-42c8-9da4-e541c393bbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:24:56.081301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef3fe-e41d-42c8-9da4-e541c393bbbd service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:24:56.081605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef3fe-e41d-42c8-9da4-e541c393bbbd service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:24:56.081858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ef3fe-e41d-42c8-9da4-e541c393bbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:24:56.094519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ef3fe-e41d-42c8-9da4-e541c393bbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:24:56.096359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ef3fe-e41d-42c8-9da4-e541c393bbbd service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:24:56.108359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1078/2154] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:25:03.923884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624f640-e6de-4c5d-90ef-591733a7f9f4 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:03.928936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624f640-e6de-4c5d-90ef-591733a7f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:03.928936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624f640-e6de-4c5d-90ef-591733a7f9f4 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:03.928936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1077/2155] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:25:03.965544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785779-5880-4961-8894-6463783055fe None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:03.966182 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785779-5880-4961-8894-6463783055fe None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:03.966351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4785779-5880-4961-8894-6463783055fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:04.000069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d4785779-5880-4961-8894-6463783055fe None None] MFA Rules not processed for user `84db64968844438b96d04172cfd0e925`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:04.001545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d4785779-5880-4961-8894-6463783055fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:04.117638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1079/2156] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:25:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:04.135667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624f640-e6de-4c5d-90ef-591733a7f9f4 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:04.137569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d624f640-e6de-4c5d-90ef-591733a7f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:04.156691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624f640-e6de-4c5d-90ef-591733a7f9f4 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:04.162258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316e0f-8e39-4863-9fa3-282b385b6f74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:04.162886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316e0f-8e39-4863-9fa3-282b385b6f74 service placement] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:04.163162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316e0f-8e39-4863-9fa3-282b385b6f74 service placement] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:04.163428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316e0f-8e39-4863-9fa3-282b385b6f74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:04.172886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316e0f-8e39-4863-9fa3-282b385b6f74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:04.174654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316e0f-8e39-4863-9fa3-282b385b6f74 service placement] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:04.185181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1078/2157] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:05.120633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4785779-5880-4961-8894-6463783055fe None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:05.122619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d4785779-5880-4961-8894-6463783055fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:05.139914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4785779-5880-4961-8894-6463783055fe None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:05.145730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:05.146634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:05.146746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:05.146955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] PATH_INFO: `/v3/users/5c08ce5eb5384347bfc4610931102cbb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:05.148594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c08ce5eb5384347bfc4610931102cbb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:05.151360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:05.335957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c08ce5eb5384347bfc4610931102cbb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:05.336689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c08ce5eb5384347bfc4610931102cbb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:05.411227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c08ce5eb5384347bfc4610931102cbb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:05.419497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c08ce5eb5384347bfc4610931102cbb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:05.432103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c08ce5eb5384347bfc4610931102cbb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:05.438145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1080/2158] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:25:05 2022] DELETE /identity/v3/users/5c08ce5eb5384347bfc4610931102cbb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:05.641236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757c5d7-2259-4e4c-bcc8-ded4a74463a7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:05.641756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757c5d7-2259-4e4c-bcc8-ded4a74463a7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:05.641859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757c5d7-2259-4e4c-bcc8-ded4a74463a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:05.662142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2757c5d7-2259-4e4c-bcc8-ded4a74463a7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:05.663346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2757c5d7-2259-4e4c-bcc8-ded4a74463a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:05.728694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:05.730310 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:05.744219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1079/2159] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:05.748964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319bdce-ef69-4658-a149-6fef0d1eb14b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:05.756052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:05.756812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:05.757062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:05.757343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] PATH_INFO: `/v3/projects/823d5a6ef2a64536a6697b926b2ce8c0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:05.758747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=823d5a6ef2a64536a6697b926b2ce8c0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:05.761125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:05.881984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823d5a6ef2a64536a6697b926b2ce8c0', 'request_id': 'req-cba09196-0872-49bc-98f0-1f4f9f86f72c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:05.883239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:05.888450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823d5a6ef2a64536a6697b926b2ce8c0', 'request_id': 'req-cba09196-0872-49bc-98f0-1f4f9f86f72c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:05.889748 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757c5d7-2259-4e4c-bcc8-ded4a74463a7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:05.891579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2757c5d7-2259-4e4c-bcc8-ded4a74463a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:05.899760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823d5a6ef2a64536a6697b926b2ce8c0', 'request_id': 'req-cba09196-0872-49bc-98f0-1f4f9f86f72c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:05.974217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757c5d7-2259-4e4c-bcc8-ded4a74463a7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:05.999806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] The token cache is being invalidate because project 823d5a6ef2a64536a6697b926b2ce8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:25:06.000147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:06.000799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:06.002506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1081/2160] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:25:05 2022] DELETE /identity/v3/projects/823d5a6ef2a64536a6697b926b2ce8c0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:25:06.006152 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:06.007466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:06.039659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:06.040914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:06.041194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:06.041463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:06.043184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:06.057065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:06.073274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba09196-0872-49bc-98f0-1f4f9f86f72c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:06.077876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:06.078501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:06.078780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:06.079056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] PATH_INFO: `/v3/users/e3c6b5eeac4749039c715cb473a9afb1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:06.080206 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c6b5eeac4749039c715cb473a9afb1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:06.082156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:06.107943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:06.109567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:06.118987 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1080/2161] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:06.225677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c6b5eeac4749039c715cb473a9afb1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:06.226618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c6b5eeac4749039c715cb473a9afb1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:06.274061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c6b5eeac4749039c715cb473a9afb1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:06.285343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c6b5eeac4749039c715cb473a9afb1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:06.303888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c2b94d4e-fc2c-4afb-b42f-99628faa7e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c6b5eeac4749039c715cb473a9afb1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:06.312926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1082/2162] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:25:06 2022] DELETE /identity/v3/users/e3c6b5eeac4749039c715cb473a9afb1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:25:06.864749 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:06.876626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d9e2a-a4ea-4e9f-b494-37dc5849d917 service nova] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:06.964753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:06.965700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:06.966103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:06.966484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] PATH_INFO: `/v3/projects/536581e604fd4a0e9ecdbd612b34a563` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:06.967755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536581e604fd4a0e9ecdbd612b34a563)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:06.969938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:07.090527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536581e604fd4a0e9ecdbd612b34a563', 'request_id': 'req-ba1eb50e-f737-4486-9067-874af7e7f3e7'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:07.095652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536581e604fd4a0e9ecdbd612b34a563', 'request_id': 'req-ba1eb50e-f737-4486-9067-874af7e7f3e7'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:07.101898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536581e604fd4a0e9ecdbd612b34a563', 'request_id': 'req-ba1eb50e-f737-4486-9067-874af7e7f3e7'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:07.170784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] The token cache is being invalidate because project 536581e604fd4a0e9ecdbd612b34a563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:25:07.171065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:07.171693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ba1eb50e-f737-4486-9067-874af7e7f3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:07.173438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1081/2163] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:25:06 2022] DELETE /identity/v3/projects/536581e604fd4a0e9ecdbd612b34a563 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:25:07.186075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078331ce-c166-48cf-b390-272c7c5fb019 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.186480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078331ce-c166-48cf-b390-272c7c5fb019 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.186748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078331ce-c166-48cf-b390-272c7c5fb019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.206123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-078331ce-c166-48cf-b390-272c7c5fb019 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:07.207320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-078331ce-c166-48cf-b390-272c7c5fb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:07.259853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:07.269545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1083/2164] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:07.278029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f7a3-e87a-4ead-bf28-b63450880b6e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.278315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f7a3-e87a-4ead-bf28-b63450880b6e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.278589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1f7a3-e87a-4ead-bf28-b63450880b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.299358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f1f1f7a3-e87a-4ead-bf28-b63450880b6e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:07.300575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f1f1f7a3-e87a-4ead-bf28-b63450880b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:07.308647 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1082/2165] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:07.312785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078331ce-c166-48cf-b390-272c7c5fb019 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:07.331706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078331ce-c166-48cf-b390-272c7c5fb019 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:07.331706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:07.331706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.332708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.332708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.333394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:25:07.333720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:07.335473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:07.349866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1084/2166] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:25:07.357628 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1f7a3-e87a-4ead-bf28-b63450880b6e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:07.367030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1f7a3-e87a-4ead-bf28-b63450880b6e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:07.372147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722fa54-9fb5-4ac0-9cc0-389660c6ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:07.372879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722fa54-9fb5-4ac0-9cc0-389660c6ca84 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.373137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722fa54-9fb5-4ac0-9cc0-389660c6ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.373408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722fa54-9fb5-4ac0-9cc0-389660c6ca84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.374050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722fa54-9fb5-4ac0-9cc0-389660c6ca84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:07.375940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722fa54-9fb5-4ac0-9cc0-389660c6ca84 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:07.472884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1083/2167] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:25:07 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:25:07.473087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:07.481404 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9d63-7f38-4de6-a0fa-b30f40053454 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:07.542296 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8e02-442d-4b29-ae8b-d2e9c26b2dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:07.542914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8e02-442d-4b29-ae8b-d2e9c26b2dac admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.543195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8e02-442d-4b29-ae8b-d2e9c26b2dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.543469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8e02-442d-4b29-ae8b-d2e9c26b2dac admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.544109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c8e02-442d-4b29-ae8b-d2e9c26b2dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:07.546066 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c8e02-442d-4b29-ae8b-d2e9c26b2dac admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:07.612035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1085/2168] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:25:07 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:25:07.616302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722fa54-9fb5-4ac0-9cc0-389660c6ca84 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:07.627343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722fa54-9fb5-4ac0-9cc0-389660c6ca84 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:07.635305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fcbe-fc2f-46f7-9f27-23082e8bbc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:07.636042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fcbe-fc2f-46f7-9f27-23082e8bbc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.636350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fcbe-fc2f-46f7-9f27-23082e8bbc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.636806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fcbe-fc2f-46f7-9f27-23082e8bbc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.637277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6fcbe-fc2f-46f7-9f27-23082e8bbc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:07.638893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6fcbe-fc2f-46f7-9f27-23082e8bbc97 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:07.650903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1084/2169] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:25:07.655135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8e02-442d-4b29-ae8b-d2e9c26b2dac admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:07.665535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8e02-442d-4b29-ae8b-d2e9c26b2dac admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:07.673658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf0d62-4503-4d06-b9ad-bb8fdef40319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:07.674273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0d62-4503-4d06-b9ad-bb8fdef40319 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.674553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0d62-4503-4d06-b9ad-bb8fdef40319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.674842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0d62-4503-4d06-b9ad-bb8fdef40319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.675506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf0d62-4503-4d06-b9ad-bb8fdef40319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:07.677153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf0d62-4503-4d06-b9ad-bb8fdef40319 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:07.689382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1086/2170] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:25:07.693485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fcbe-fc2f-46f7-9f27-23082e8bbc97 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:07.699210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:07.704635 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fcbe-fc2f-46f7-9f27-23082e8bbc97 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:07.710318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9310c3-bd10-4551-868a-3d662a07b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:07.711154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9310c3-bd10-4551-868a-3d662a07b81d admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.711433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9310c3-bd10-4551-868a-3d662a07b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.714692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9310c3-bd10-4551-868a-3d662a07b81d admin admin] PATH_INFO: `/v3/projects/ce79d6fcc2aa48129b41c504bf79d588/users/ca1cfcf4dce84d8095611e98c799ed18/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.731961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9310c3-bd10-4551-868a-3d662a07b81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce79d6fcc2aa48129b41c504bf79d588, user_id=ca1cfcf4dce84d8095611e98c799ed18, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:07.734706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9310c3-bd10-4551-868a-3d662a07b81d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:07.817322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1085/2171] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:25:07 2022] PUT /identity/v3/projects/ce79d6fcc2aa48129b41c504bf79d588/users/ca1cfcf4dce84d8095611e98c799ed18/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:07.828403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0bfd-bf5c-4016-b236-a0f59f89e403 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:07.828699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0bfd-bf5c-4016-b236-a0f59f89e403 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:07.828977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0bfd-bf5c-4016-b236-a0f59f89e403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:07.861508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-094d0bfd-bf5c-4016-b236-a0f59f89e403 None None] MFA Rules not processed for user `ca1cfcf4dce84d8095611e98c799ed18`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:07.862662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-094d0bfd-bf5c-4016-b236-a0f59f89e403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:07.936418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1087/2172] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:07.940796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9310c3-bd10-4551-868a-3d662a07b81d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:08.029450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9310c3-bd10-4551-868a-3d662a07b81d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:08.034527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ebe60-1bf5-46bb-b208-cc63cf0e43c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:08.035138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ebe60-1bf5-46bb-b208-cc63cf0e43c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:08.035421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ebe60-1bf5-46bb-b208-cc63cf0e43c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:08.035692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ebe60-1bf5-46bb-b208-cc63cf0e43c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:08.036359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ebe60-1bf5-46bb-b208-cc63cf0e43c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:08.038254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ebe60-1bf5-46bb-b208-cc63cf0e43c2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:08.372564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1086/2173] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:25:07 2022] POST /identity/v3/projects => generated 385 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:25:08.377914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0bfd-bf5c-4016-b236-a0f59f89e403 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:08.395242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0bfd-bf5c-4016-b236-a0f59f89e403 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:08.467231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:08.479093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5714-7e20-414b-9218-dcfd917afe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:08.479808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5714-7e20-414b-9218-dcfd917afe2a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:08.480092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5714-7e20-414b-9218-dcfd917afe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:08.480391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5714-7e20-414b-9218-dcfd917afe2a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:08.481214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b5714-7e20-414b-9218-dcfd917afe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:08.483177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b5714-7e20-414b-9218-dcfd917afe2a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:08.802510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1088/2174] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:25:08 2022] POST /identity/v3/users => generated 299 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:25:08.805047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ebe60-1bf5-46bb-b208-cc63cf0e43c2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:08.830417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ebe60-1bf5-46bb-b208-cc63cf0e43c2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:08.838420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd2a77-0847-440d-b170-f4c4dbe0e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:08.839041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd2a77-0847-440d-b170-f4c4dbe0e4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:08.839322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd2a77-0847-440d-b170-f4c4dbe0e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:08.839605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd2a77-0847-440d-b170-f4c4dbe0e4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:08.840289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd2a77-0847-440d-b170-f4c4dbe0e4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:08.841967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd2a77-0847-440d-b170-f4c4dbe0e4f2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:08.854203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1087/2175] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:25:08.858522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5714-7e20-414b-9218-dcfd917afe2a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:08.869785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5714-7e20-414b-9218-dcfd917afe2a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:08.875592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ca60-5f87-4296-83c4-31359df992c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:08.876676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ca60-5f87-4296-83c4-31359df992c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:08.876895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ca60-5f87-4296-83c4-31359df992c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:08.877177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517ca60-5f87-4296-83c4-31359df992c7 admin admin] PATH_INFO: `/v3/projects/5beea80735814da884668393df78b64d/users/553d463c366b42e981ea38d91d0e8c72/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:08.898770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517ca60-5f87-4296-83c4-31359df992c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5beea80735814da884668393df78b64d, user_id=553d463c366b42e981ea38d91d0e8c72, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:08.901966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517ca60-5f87-4296-83c4-31359df992c7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:08.980363 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1089/2176] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:25:08 2022] PUT /identity/v3/projects/5beea80735814da884668393df78b64d/users/553d463c366b42e981ea38d91d0e8c72/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:08.983841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd2a77-0847-440d-b170-f4c4dbe0e4f2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:08.995533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd2a77-0847-440d-b170-f4c4dbe0e4f2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:09.073517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d8930-9342-49a2-8ac1-1ef7e5f879a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:09.074133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8930-9342-49a2-8ac1-1ef7e5f879a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:09.074599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8930-9342-49a2-8ac1-1ef7e5f879a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:09.074850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8930-9342-49a2-8ac1-1ef7e5f879a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:09.075551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d8930-9342-49a2-8ac1-1ef7e5f879a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:09.077139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d8930-9342-49a2-8ac1-1ef7e5f879a5 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:09.088886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1088/2177] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:25:09.092945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ca60-5f87-4296-83c4-31359df992c7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:09.103489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517ca60-5f87-4296-83c4-31359df992c7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:09.108449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:09.109705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:09.109705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:09.109705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] PATH_INFO: `/v3/projects/5beea80735814da884668393df78b64d/users/553d463c366b42e981ea38d91d0e8c72/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:09.111723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5beea80735814da884668393df78b64d, user_id=553d463c366b42e981ea38d91d0e8c72, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:09.117877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:09.138738 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1090/2178] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:25:09 2022] PUT /identity/v3/projects/5beea80735814da884668393df78b64d/users/553d463c366b42e981ea38d91d0e8c72/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:09.153102 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff53c39-73a1-4117-ae29-2c11431448b1 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:09.153295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff53c39-73a1-4117-ae29-2c11431448b1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:09.153559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff53c39-73a1-4117-ae29-2c11431448b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:09.183702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-3ff53c39-73a1-4117-ae29-2c11431448b1 None None] MFA Rules not processed for user `553d463c366b42e981ea38d91d0e8c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:09.184961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3ff53c39-73a1-4117-ae29-2c11431448b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:09.233052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:09.274144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1089/2179] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:09.293182 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:09.295113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:09.366836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6d08f-9882-431d-b475-147d224c4ed2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:09.388865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:09.390868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:09.391307 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:09.391730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:09.463704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:09.465212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:09.474229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1091/2180] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:11.748359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638748c-ba1b-47a0-a690-b4a1c71db77e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:11.748359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638748c-ba1b-47a0-a690-b4a1c71db77e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:11.748359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638748c-ba1b-47a0-a690-b4a1c71db77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:11.903540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-1638748c-ba1b-47a0-a690-b4a1c71db77e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:11.904767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1638748c-ba1b-47a0-a690-b4a1c71db77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:11.992091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1090/2181] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:12.019795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:12.021741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:12.097127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:12.114018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40087af6-a026-4a06-b193-8a077c8ec88d service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:12.123080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5559376-0e0d-421c-965f-a22472438b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:12.123963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5559376-0e0d-421c-965f-a22472438b38 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:12.124324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5559376-0e0d-421c-965f-a22472438b38 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:12.124663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5559376-0e0d-421c-965f-a22472438b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:12.134913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5559376-0e0d-421c-965f-a22472438b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:12.136009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5559376-0e0d-421c-965f-a22472438b38 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:12.146692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1092/2182] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:14.779825 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638748c-ba1b-47a0-a690-b4a1c71db77e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:14.781390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1638748c-ba1b-47a0-a690-b4a1c71db77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:14.794129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638748c-ba1b-47a0-a690-b4a1c71db77e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:14.798231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c075d97-5316-4f77-9252-80d8dff62f6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:14.798440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c075d97-5316-4f77-9252-80d8dff62f6b service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:14.798733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c075d97-5316-4f77-9252-80d8dff62f6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:14.799026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c075d97-5316-4f77-9252-80d8dff62f6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:14.809605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c075d97-5316-4f77-9252-80d8dff62f6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:14.810812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c075d97-5316-4f77-9252-80d8dff62f6b service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:14.821894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1091/2183] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:16.374863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb457a6-433f-444f-84bd-424d223e2cab None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:16.375411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb457a6-433f-444f-84bd-424d223e2cab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:16.375526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb457a6-433f-444f-84bd-424d223e2cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:16.394949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-abb457a6-433f-444f-84bd-424d223e2cab None None] MFA Rules not processed for user `91c4e4c7039a43129d9912ba4e69fbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:16.396140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-abb457a6-433f-444f-84bd-424d223e2cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:16.452709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1093/2184] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:18.528228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29491ad-286b-465b-9818-34ca734b6dd8 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:18.529436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29491ad-286b-465b-9818-34ca734b6dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:18.529754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29491ad-286b-465b-9818-34ca734b6dd8 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:18.531374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1092/2185] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:25:18.538149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcfa34-2618-42ac-a7ac-13a9682b5497 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:18.538677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcfa34-2618-42ac-a7ac-13a9682b5497 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:18.538677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcfa34-2618-42ac-a7ac-13a9682b5497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:18.565611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-00bcfa34-2618-42ac-a7ac-13a9682b5497 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:18.565611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-00bcfa34-2618-42ac-a7ac-13a9682b5497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:18.592906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1094/2186] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:25:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:25:18.600838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29491ad-286b-465b-9818-34ca734b6dd8 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:18.602701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b29491ad-286b-465b-9818-34ca734b6dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:18.686640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29491ad-286b-465b-9818-34ca734b6dd8 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:18.691849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958163a7-de63-4531-abb8-0fc2e53c4aa1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc7327f524a450e8429b5008166e5d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:18.695898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958163a7-de63-4531-abb8-0fc2e53c4aa1 service glance] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:18.695898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958163a7-de63-4531-abb8-0fc2e53c4aa1 service glance] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:18.695898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958163a7-de63-4531-abb8-0fc2e53c4aa1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:18.705075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958163a7-de63-4531-abb8-0fc2e53c4aa1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:18.706527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958163a7-de63-4531-abb8-0fc2e53c4aa1 service glance] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:18.718410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1093/2187] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:19.046607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d88ed-8aa2-4879-bf88-9b25cbbd71b9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:19.051586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d88ed-8aa2-4879-bf88-9b25cbbd71b9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:19.051586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d88ed-8aa2-4879-bf88-9b25cbbd71b9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:19.051586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1095/2188] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:25:19.053388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb597-d5c0-4c5b-9a37-284ec76bdab0 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:19.053679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb597-d5c0-4c5b-9a37-284ec76bdab0 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:19.053970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb597-d5c0-4c5b-9a37-284ec76bdab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:19.073845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f1cfb597-d5c0-4c5b-9a37-284ec76bdab0 None None] MFA Rules not processed for user `512aab5a19c94651bfa0f634244dbdab`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:19.075039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f1cfb597-d5c0-4c5b-9a37-284ec76bdab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:19.139124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1094/2189] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:25:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:19.158101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d88ed-8aa2-4879-bf88-9b25cbbd71b9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:19.159809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bc0d88ed-8aa2-4879-bf88-9b25cbbd71b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:19.174171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d88ed-8aa2-4879-bf88-9b25cbbd71b9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:19.177681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebd561-b240-4d53-b1c6-672b6f18091a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:19.178348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebd561-b240-4d53-b1c6-672b6f18091a service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:19.178634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebd561-b240-4d53-b1c6-672b6f18091a service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:19.179517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebd561-b240-4d53-b1c6-672b6f18091a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:19.188227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebd561-b240-4d53-b1c6-672b6f18091a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:19.189723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebd561-b240-4d53-b1c6-672b6f18091a service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:19.199215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1096/2190] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:25:19.290243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b4f71-c4c4-463c-aaeb-d916a1c939d5 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:19.291457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b4f71-c4c4-463c-aaeb-d916a1c939d5 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:19.292088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b4f71-c4c4-463c-aaeb-d916a1c939d5 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:19.293639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1095/2191] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:25:19.300433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff7ca-fcb6-47bd-8b84-cce61b2e29bc None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:19.300726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff7ca-fcb6-47bd-8b84-cce61b2e29bc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:19.310900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff7ca-fcb6-47bd-8b84-cce61b2e29bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:19.322363 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-981ff7ca-fcb6-47bd-8b84-cce61b2e29bc None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:19.323737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-981ff7ca-fcb6-47bd-8b84-cce61b2e29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:19.333527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1097/2192] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:25:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:19.344465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b4f71-c4c4-463c-aaeb-d916a1c939d5 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:19.356110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b4f71-c4c4-463c-aaeb-d916a1c939d5 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:19.359746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95f078-0010-4a43-b0e1-05d15817a753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:19.360357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95f078-0010-4a43-b0e1-05d15817a753 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:19.360639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95f078-0010-4a43-b0e1-05d15817a753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:19.360909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95f078-0010-4a43-b0e1-05d15817a753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:19.372517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95f078-0010-4a43-b0e1-05d15817a753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:19.374366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95f078-0010-4a43-b0e1-05d15817a753 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:19.380813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:19.386217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1096/2193] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:20.291659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604ccc-cfe7-4582-885f-c31e30ac282c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:20.292194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604ccc-cfe7-4582-885f-c31e30ac282c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:20.292194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604ccc-cfe7-4582-885f-c31e30ac282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:20.311820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-33604ccc-cfe7-4582-885f-c31e30ac282c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:20.318174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-33604ccc-cfe7-4582-885f-c31e30ac282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:20.320903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1098/2194] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:20.344814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95f078-0010-4a43-b0e1-05d15817a753 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:20.355851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95f078-0010-4a43-b0e1-05d15817a753 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:20.361476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f515-f1b2-4303-97ca-aaa75e092f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:20.362073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f515-f1b2-4303-97ca-aaa75e092f61 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:20.362346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f515-f1b2-4303-97ca-aaa75e092f61 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:20.362826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f515-f1b2-4303-97ca-aaa75e092f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:20.371883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98f515-f1b2-4303-97ca-aaa75e092f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:20.373472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98f515-f1b2-4303-97ca-aaa75e092f61 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:20.383460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1097/2195] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:20.732913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33604ccc-cfe7-4582-885f-c31e30ac282c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:20.742952 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33604ccc-cfe7-4582-885f-c31e30ac282c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:20.752845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:20.756112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:20.756112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:20.756112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] PATH_INFO: `/v3/users/ca1cfcf4dce84d8095611e98c799ed18` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:20.756112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1cfcf4dce84d8095611e98c799ed18)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:20.758598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:20.961200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1cfcf4dce84d8095611e98c799ed18'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:20.961886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1cfcf4dce84d8095611e98c799ed18'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:21.101490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1cfcf4dce84d8095611e98c799ed18'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:21.121817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1cfcf4dce84d8095611e98c799ed18'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:21.142236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1cfcf4dce84d8095611e98c799ed18'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:21.152633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1099/2196] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:25:20 2022] DELETE /identity/v3/users/ca1cfcf4dce84d8095611e98c799ed18 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:21.156072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4507-d818-436a-b26b-40aa29948535 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:21.156377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4507-d818-436a-b26b-40aa29948535 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:21.156651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da4507-d818-436a-b26b-40aa29948535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:21.182943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c3da4507-d818-436a-b26b-40aa29948535 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:21.184176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c3da4507-d818-436a-b26b-40aa29948535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:21.255205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1098/2197] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:21.268763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:21.270193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:21.304601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:21.329313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47dd36-c18b-4cf0-9045-a3ab6706a9f9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:21.332998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee169ed2-f5c3-47fc-b11d-4120e06df709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:21.333553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169ed2-f5c3-47fc-b11d-4120e06df709 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:21.333850 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169ed2-f5c3-47fc-b11d-4120e06df709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:21.334102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169ed2-f5c3-47fc-b11d-4120e06df709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:21.343757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee169ed2-f5c3-47fc-b11d-4120e06df709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:21.345246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee169ed2-f5c3-47fc-b11d-4120e06df709 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:21.355894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1100/2198] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:21.812180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da4507-d818-436a-b26b-40aa29948535 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:21.814688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c3da4507-d818-436a-b26b-40aa29948535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:21.831990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da4507-d818-436a-b26b-40aa29948535 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:21.838611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:21.839396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:21.839908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:21.840437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] PATH_INFO: `/v3/projects/ce79d6fcc2aa48129b41c504bf79d588` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:21.841742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce79d6fcc2aa48129b41c504bf79d588)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:21.843820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:22.020113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce79d6fcc2aa48129b41c504bf79d588', 'request_id': 'req-8fccf512-2011-4aa9-89cc-1098ca345985'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.027977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce79d6fcc2aa48129b41c504bf79d588', 'request_id': 'req-8fccf512-2011-4aa9-89cc-1098ca345985'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.033901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce79d6fcc2aa48129b41c504bf79d588', 'request_id': 'req-8fccf512-2011-4aa9-89cc-1098ca345985'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.144961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] The token cache is being invalidate because project ce79d6fcc2aa48129b41c504bf79d588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:25:22.145342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.146254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.148364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1099/2199] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:25:21 2022] DELETE /identity/v3/projects/ce79d6fcc2aa48129b41c504bf79d588 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:22.152709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee169ed2-f5c3-47fc-b11d-4120e06df709 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:22.166266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee169ed2-f5c3-47fc-b11d-4120e06df709 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:22.229467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:22.230099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:22.230381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:22.230660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] PATH_INFO: `/v3/users/553d463c366b42e981ea38d91d0e8c72` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:22.231904 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553d463c366b42e981ea38d91d0e8c72)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:22.233923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:22.475924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553d463c366b42e981ea38d91d0e8c72'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.476651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553d463c366b42e981ea38d91d0e8c72'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.530098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553d463c366b42e981ea38d91d0e8c72'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.537591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553d463c366b42e981ea38d91d0e8c72'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.549735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-06e80dec-f0c6-4eb8-991c-9dcfa2d7e950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553d463c366b42e981ea38d91d0e8c72'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:22.555819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1101/2200] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:25:22 2022] DELETE /identity/v3/users/553d463c366b42e981ea38d91d0e8c72 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:23.020045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:23.021557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:23.037409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccf512-2011-4aa9-89cc-1098ca345985 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:23.105058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:23.105741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:23.106024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:23.106303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] PATH_INFO: `/v3/projects/5beea80735814da884668393df78b64d` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:23.109480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5beea80735814da884668393df78b64d)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:23.112784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:23.130477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:23.253841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5beea80735814da884668393df78b64d', 'request_id': 'req-b28f2106-0451-4438-b60b-0773d33251bc'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:23.269564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5beea80735814da884668393df78b64d', 'request_id': 'req-b28f2106-0451-4438-b60b-0773d33251bc'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:23.284878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5beea80735814da884668393df78b64d', 'request_id': 'req-b28f2106-0451-4438-b60b-0773d33251bc'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:23.416398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] The token cache is being invalidate because project 5beea80735814da884668393df78b64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:25:23.416398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:23.417008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b28f2106-0451-4438-b60b-0773d33251bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:23.419821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1100/2201] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:25:23 2022] DELETE /identity/v3/projects/5beea80735814da884668393df78b64d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:23.426361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d136-6a26-43d2-b060-1664df040c7f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:23.426711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d136-6a26-43d2-b060-1664df040c7f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:23.426991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d136-6a26-43d2-b060-1664df040c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:23.454532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8f58d136-6a26-43d2-b060-1664df040c7f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:23.455865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8f58d136-6a26-43d2-b060-1664df040c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:23.518254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:23.538332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1102/2202] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:23.546798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fadc6f-f63e-43db-be4f-afbb4f7f270d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:23.547090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fadc6f-f63e-43db-be4f-afbb4f7f270d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:23.552079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fadc6f-f63e-43db-be4f-afbb4f7f270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:23.569685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-04fadc6f-f63e-43db-be4f-afbb4f7f270d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:23.572088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-04fadc6f-f63e-43db-be4f-afbb4f7f270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:23.585006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1101/2203] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:23.586550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d136-6a26-43d2-b060-1664df040c7f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:23.600296 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d136-6a26-43d2-b060-1664df040c7f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:23.606469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:23.607366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:23.607646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:23.607920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:23.609002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:25:23.609868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:23.616752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:23.628394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1103/2204] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:25:23.630698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fadc6f-f63e-43db-be4f-afbb4f7f270d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:23.640826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fadc6f-f63e-43db-be4f-afbb4f7f270d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:23.645676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c32483-ce5c-4908-9100-9b85d9ad56c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:23.646295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c32483-ce5c-4908-9100-9b85d9ad56c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:23.646575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c32483-ce5c-4908-9100-9b85d9ad56c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:23.646846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c32483-ce5c-4908-9100-9b85d9ad56c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:23.647513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c32483-ce5c-4908-9100-9b85d9ad56c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:23.650243 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c32483-ce5c-4908-9100-9b85d9ad56c8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:23.740129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1102/2205] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:25:23 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:25:23.743174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:23.764103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dbd5e-6790-496a-8b64-436a65c7778a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:23.865602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae5db-825b-4567-bacc-29abdee6ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:23.866454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae5db-825b-4567-bacc-29abdee6ab27 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:23.867625 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae5db-825b-4567-bacc-29abdee6ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:23.867919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae5db-825b-4567-bacc-29abdee6ab27 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:23.868966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ae5db-825b-4567-bacc-29abdee6ab27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:23.870961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ae5db-825b-4567-bacc-29abdee6ab27 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:23.941555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1104/2206] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:25:23 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:25:23.942671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c32483-ce5c-4908-9100-9b85d9ad56c8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:23.954883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c32483-ce5c-4908-9100-9b85d9ad56c8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:23.960248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab77fcd-47ac-4e38-a49e-a9bfacf3ab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:23.961211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77fcd-47ac-4e38-a49e-a9bfacf3ab11 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:23.961414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77fcd-47ac-4e38-a49e-a9bfacf3ab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:23.961694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77fcd-47ac-4e38-a49e-a9bfacf3ab11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:23.963052 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab77fcd-47ac-4e38-a49e-a9bfacf3ab11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:23.964599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab77fcd-47ac-4e38-a49e-a9bfacf3ab11 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:23.976287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1103/2207] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:25:23.980373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae5db-825b-4567-bacc-29abdee6ab27 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:23.992794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae5db-825b-4567-bacc-29abdee6ab27 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:23.999791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e348668-4202-43c3-a346-7828726edbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:24.000744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348668-4202-43c3-a346-7828726edbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:24.001242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348668-4202-43c3-a346-7828726edbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:24.001758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348668-4202-43c3-a346-7828726edbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:24.002648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e348668-4202-43c3-a346-7828726edbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:24.005132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e348668-4202-43c3-a346-7828726edbe9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:24.027685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1105/2208] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:25:24.032365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab77fcd-47ac-4e38-a49e-a9bfacf3ab11 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:24.045069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab77fcd-47ac-4e38-a49e-a9bfacf3ab11 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:24.052788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:24.053517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:24.053803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:24.054117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] PATH_INFO: `/v3/projects/50dc2e64933b4a089c99ad0a6725ec8e/users/a8d606924ab8416d9ea835d903c12dab/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:24.070904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50dc2e64933b4a089c99ad0a6725ec8e, user_id=a8d606924ab8416d9ea835d903c12dab, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:24.074373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:24.136970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1104/2209] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:25:24 2022] PUT /identity/v3/projects/50dc2e64933b4a089c99ad0a6725ec8e/users/a8d606924ab8416d9ea835d903c12dab/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:24.151185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e05577-71a7-4317-90de-cef4d0d539db None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:24.151658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e05577-71a7-4317-90de-cef4d0d539db None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:24.152380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e05577-71a7-4317-90de-cef4d0d539db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:24.186443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-05e05577-71a7-4317-90de-cef4d0d539db None None] MFA Rules not processed for user `a8d606924ab8416d9ea835d903c12dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:24.187929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-05e05577-71a7-4317-90de-cef4d0d539db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:24.269867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1106/2210] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:24.284082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:24.286893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:24.348466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4475f-95b7-47b6-94b1-76f9601ea741 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:24.352504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:24.353552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:24.353920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:24.354268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:24.380539 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:24.380539 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:24.392828 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1105/2211] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:24.465938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c28a91-4c1c-4477-b1fb-6be5357fcdd2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:24.466475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c28a91-4c1c-4477-b1fb-6be5357fcdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:24.466819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c28a91-4c1c-4477-b1fb-6be5357fcdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:24.486543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-15c28a91-4c1c-4477-b1fb-6be5357fcdd2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:24.487659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-15c28a91-4c1c-4477-b1fb-6be5357fcdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:24.537725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:24.569329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1107/2212] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:24.590810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:24.592849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:24.641554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:24.672585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f5083-18a8-431d-a319-5efc7576e41e service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:24.678346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563887d-d90b-429e-ba47-b943a4735f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:24.679021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563887d-d90b-429e-ba47-b943a4735f26 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:24.679363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563887d-d90b-429e-ba47-b943a4735f26 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:24.679697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563887d-d90b-429e-ba47-b943a4735f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:24.692553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563887d-d90b-429e-ba47-b943a4735f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:24.694877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563887d-d90b-429e-ba47-b943a4735f26 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:24.707679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1106/2213] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:29.713613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c28a91-4c1c-4477-b1fb-6be5357fcdd2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:29.715122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-15c28a91-4c1c-4477-b1fb-6be5357fcdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:29.780051 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c28a91-4c1c-4477-b1fb-6be5357fcdd2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:29.784414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:29.785595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:29.785945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:29.786284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:29.788098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:29.857763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:29.859239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:29.869544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1108/2214] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:30.673208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9bdd-ed94-4025-9c6e-e46ab86554ec None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:30.673688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9bdd-ed94-4025-9c6e-e46ab86554ec None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:30.673905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9bdd-ed94-4025-9c6e-e46ab86554ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:30.694020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5c7e9bdd-ed94-4025-9c6e-e46ab86554ec None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:30.695300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5c7e9bdd-ed94-4025-9c6e-e46ab86554ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:30.752624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1107/2215] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:30.775928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:30.777396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:30.852045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592739-4d21-4801-b3d9-0832c04fb422 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:30.857992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a23ad-4f96-447b-be68-078ba88b6b62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:30.858768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a23ad-4f96-447b-be68-078ba88b6b62 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:30.858915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a23ad-4f96-447b-be68-078ba88b6b62 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:30.859191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a23ad-4f96-447b-be68-078ba88b6b62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:30.868530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a23ad-4f96-447b-be68-078ba88b6b62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:30.870813 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a23ad-4f96-447b-be68-078ba88b6b62 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:30.879422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1109/2216] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:25:40.745685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=41 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:40.876086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:43.132560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e9bdd-ed94-4025-9c6e-e46ab86554ec None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:43.143848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e9bdd-ed94-4025-9c6e-e46ab86554ec None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:43.148343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:43.149450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:43.149751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:43.150023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] PATH_INFO: `/v3/users/a8d606924ab8416d9ea835d903c12dab` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:43.151143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d606924ab8416d9ea835d903c12dab)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:43.153071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:43.350858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d606924ab8416d9ea835d903c12dab'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:43.425450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d606924ab8416d9ea835d903c12dab'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:43.426059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d606924ab8416d9ea835d903c12dab'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:43.437966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d606924ab8416d9ea835d903c12dab'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:43.443004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d606924ab8416d9ea835d903c12dab'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:43.450903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1108/2217] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:25:43 2022] DELETE /identity/v3/users/a8d606924ab8416d9ea835d903c12dab => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:43.455352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259723e8-aa12-4aac-8374-c95ae2e46cbf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:43.455911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259723e8-aa12-4aac-8374-c95ae2e46cbf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:43.455911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259723e8-aa12-4aac-8374-c95ae2e46cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:43.475043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-259723e8-aa12-4aac-8374-c95ae2e46cbf None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:43.476263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-259723e8-aa12-4aac-8374-c95ae2e46cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:43.535639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1110/2218] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:43.545486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:43.546915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:43.601984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13249414-cc03-4aa3-8272-0d65ad03e6b1 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:43.605668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a26090-7557-4811-a7fc-13462e00bb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:43.606268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a26090-7557-4811-a7fc-13462e00bb65 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:43.606548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a26090-7557-4811-a7fc-13462e00bb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:43.606820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a26090-7557-4811-a7fc-13462e00bb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:43.615529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a26090-7557-4811-a7fc-13462e00bb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:43.616983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a26090-7557-4811-a7fc-13462e00bb65 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:43.626705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1109/2219] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:25:44.050816 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259723e8-aa12-4aac-8374-c95ae2e46cbf None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:44.052417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-259723e8-aa12-4aac-8374-c95ae2e46cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:44.067869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259723e8-aa12-4aac-8374-c95ae2e46cbf None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:44.073456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:44.074032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.074471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.074752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] PATH_INFO: `/v3/projects/50dc2e64933b4a089c99ad0a6725ec8e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.075877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=50dc2e64933b4a089c99ad0a6725ec8e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:44.078011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:44.192826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50dc2e64933b4a089c99ad0a6725ec8e', 'request_id': 'req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:44.198341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50dc2e64933b4a089c99ad0a6725ec8e', 'request_id': 'req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:44.204466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50dc2e64933b4a089c99ad0a6725ec8e', 'request_id': 'req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:44.294925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] The token cache is being invalidate because project 50dc2e64933b4a089c99ad0a6725ec8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:25:44.295137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:44.295767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f4a4ce6e-1725-493e-ab60-4a1bae261d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:25:44.297297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1111/2220] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:25:44 2022] DELETE /identity/v3/projects/50dc2e64933b4a089c99ad0a6725ec8e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:25:44.302323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb1d6-cecd-4eb5-8fb4-d3288718a47c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.302813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb1d6-cecd-4eb5-8fb4-d3288718a47c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.302919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb1d6-cecd-4eb5-8fb4-d3288718a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.323947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f5ebb1d6-cecd-4eb5-8fb4-d3288718a47c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:44.325321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f5ebb1d6-cecd-4eb5-8fb4-d3288718a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:44.427871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1110/2221] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:44.435854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245033f-76f3-46f2-99c3-1c24646733b2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.436219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245033f-76f3-46f2-99c3-1c24646733b2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.436605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245033f-76f3-46f2-99c3-1c24646733b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.457291 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c245033f-76f3-46f2-99c3-1c24646733b2 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:44.459228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c245033f-76f3-46f2-99c3-1c24646733b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:44.469348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1112/2222] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:44.473575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebb1d6-cecd-4eb5-8fb4-d3288718a47c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:44.484181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebb1d6-cecd-4eb5-8fb4-d3288718a47c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:44.490317 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:44.490925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.491203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.491475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.492126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:25:44.492457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:44.494384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:44.506550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1111/2223] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:25:44.511123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245033f-76f3-46f2-99c3-1c24646733b2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:44.520898 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245033f-76f3-46f2-99c3-1c24646733b2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:44.526411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0bb58-9002-41fb-83d4-a49b128aa12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:44.527039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0bb58-9002-41fb-83d4-a49b128aa12e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.527614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0bb58-9002-41fb-83d4-a49b128aa12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.528057 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0bb58-9002-41fb-83d4-a49b128aa12e admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.528755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0bb58-9002-41fb-83d4-a49b128aa12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:44.530659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0bb58-9002-41fb-83d4-a49b128aa12e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:44.610836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1113/2224] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:25:44 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:25:44.615186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:44.620549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:44.625760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fde3-3d28-47a1-81a2-a77e8f956716 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:44.681948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464c06-d3ec-474a-9f24-6f97d1bc9543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:44.682576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464c06-d3ec-474a-9f24-6f97d1bc9543 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.682850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464c06-d3ec-474a-9f24-6f97d1bc9543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.683120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b464c06-d3ec-474a-9f24-6f97d1bc9543 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.683738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b464c06-d3ec-474a-9f24-6f97d1bc9543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:44.685656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b464c06-d3ec-474a-9f24-6f97d1bc9543 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:44.763495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1112/2225] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:25:44 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:25:44.767946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0bb58-9002-41fb-83d4-a49b128aa12e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:44.778864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0bb58-9002-41fb-83d4-a49b128aa12e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:44.783354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b365-2fbd-446a-a2ed-713fb90bfe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:44.783953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b365-2fbd-446a-a2ed-713fb90bfe40 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.784228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b365-2fbd-446a-a2ed-713fb90bfe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.784523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b365-2fbd-446a-a2ed-713fb90bfe40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.785165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0b365-2fbd-446a-a2ed-713fb90bfe40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:44.786725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0b365-2fbd-446a-a2ed-713fb90bfe40 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:44.796297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1114/2226] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:25:44.802554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464c06-d3ec-474a-9f24-6f97d1bc9543 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:44.812334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b464c06-d3ec-474a-9f24-6f97d1bc9543 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:44.816905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47929ab0-476e-45b3-982d-53781c2ab53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:44.817518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47929ab0-476e-45b3-982d-53781c2ab53f admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.817794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47929ab0-476e-45b3-982d-53781c2ab53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.818064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47929ab0-476e-45b3-982d-53781c2ab53f admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.818764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47929ab0-476e-45b3-982d-53781c2ab53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:44.820616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47929ab0-476e-45b3-982d-53781c2ab53f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:44.831456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1113/2227] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:25:44.835697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b365-2fbd-446a-a2ed-713fb90bfe40 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:44.846294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b365-2fbd-446a-a2ed-713fb90bfe40 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:44.850983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:44.851655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.851934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.852207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] PATH_INFO: `/v3/projects/0d7269cbfa5546148080988fca0697a2/users/a251a6945b2547bab1718157f333e48d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.866447 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7269cbfa5546148080988fca0697a2, user_id=a251a6945b2547bab1718157f333e48d, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:44.869199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:44.957495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1115/2228] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:25:44 2022] PUT /identity/v3/projects/0d7269cbfa5546148080988fca0697a2/users/a251a6945b2547bab1718157f333e48d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:25:44.968638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab41a-8a0c-4cce-a9f4-0f6a7a542898 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:44.968926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab41a-8a0c-4cce-a9f4-0f6a7a542898 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:44.969202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab41a-8a0c-4cce-a9f4-0f6a7a542898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:44.997502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a6dab41a-8a0c-4cce-a9f4-0f6a7a542898 None None] MFA Rules not processed for user `a251a6945b2547bab1718157f333e48d`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:44.998701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a6dab41a-8a0c-4cce-a9f4-0f6a7a542898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:45.062120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1114/2229] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:45.075164 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:45.077053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:45.102060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:45.147775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc10f8-a793-40d6-bb40-912527a56b9a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:45.152387 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc7327f524a450e8429b5008166e5d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:45.153005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:45.153284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:45.153556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:45.162606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:45.164057 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:45.174351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1116/2230] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:25:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:25:55.059287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:55.316975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=17 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:59.107204 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fca81-f1f3-40d9-8b83-97738def94ac None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:59.108087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fca81-f1f3-40d9-8b83-97738def94ac None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:59.108715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fca81-f1f3-40d9-8b83-97738def94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:59.131035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-861fca81-f1f3-40d9-8b83-97738def94ac None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:25:59.132480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-861fca81-f1f3-40d9-8b83-97738def94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:59.189975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1115/2231] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 11:25:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:25:59.203211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:25:59.204811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:25:59.274068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cec89-fc44-437b-9206-ceff133dd193 service glance] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:25:59.279890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d88a26-3df4-4332-a788-a3289de9bd89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:25:59.280541 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d88a26-3df4-4332-a788-a3289de9bd89 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:25:59.280820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d88a26-3df4-4332-a788-a3289de9bd89 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:25:59.281089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d88a26-3df4-4332-a788-a3289de9bd89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:25:59.289217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d88a26-3df4-4332-a788-a3289de9bd89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:25:59.290764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d88a26-3df4-4332-a788-a3289de9bd89 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:25:59.298784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1117/2232] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:25:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:26:02.675081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fca81-f1f3-40d9-8b83-97738def94ac None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:02.676672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-861fca81-f1f3-40d9-8b83-97738def94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:02.760362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fca81-f1f3-40d9-8b83-97738def94ac None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:02.767978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b2a5d-d978-4e63-83d9-0f804102c332 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:02.768702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2a5d-d978-4e63-83d9-0f804102c332 service placement] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:02.768983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2a5d-d978-4e63-83d9-0f804102c332 service placement] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:02.769314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b2a5d-d978-4e63-83d9-0f804102c332 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:02.771860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-636b2a5d-d978-4e63-83d9-0f804102c332 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:02.785638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b2a5d-d978-4e63-83d9-0f804102c332 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:02.788152 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b2a5d-d978-4e63-83d9-0f804102c332 service placement] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:02.800461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1116/2233] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:09.295811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=32 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:10.370644 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1f82-2dff-416f-b811-0f4b29ba372b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:10.375565 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1f82-2dff-416f-b811-0f4b29ba372b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:10.375945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1f82-2dff-416f-b811-0f4b29ba372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:10.400293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d74d1f82-2dff-416f-b811-0f4b29ba372b None None] MFA Rules not processed for user `417c03798c594b2681776069f77bce5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:10.406595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d74d1f82-2dff-416f-b811-0f4b29ba372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:10.475244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1118/2234] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:26:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:12.684548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421826b-9eb0-4ead-a3e1-a29db9976136 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:12.685825 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421826b-9eb0-4ead-a3e1-a29db9976136 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:12.686315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421826b-9eb0-4ead-a3e1-a29db9976136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:12.709304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-0421826b-9eb0-4ead-a3e1-a29db9976136 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:12.710979 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0421826b-9eb0-4ead-a3e1-a29db9976136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:12.736561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1117/2235] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:26:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:12.736921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d1f82-2dff-416f-b811-0f4b29ba372b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:12.756599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d1f82-2dff-416f-b811-0f4b29ba372b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:12.770989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7e0ac-d425-4452-ab19-a5fbfbd1244b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:12.771638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e0ac-d425-4452-ab19-a5fbfbd1244b service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:12.771926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e0ac-d425-4452-ab19-a5fbfbd1244b service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:12.772242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7e0ac-d425-4452-ab19-a5fbfbd1244b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:12.793995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e0ac-d425-4452-ab19-a5fbfbd1244b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:12.820024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7e0ac-d425-4452-ab19-a5fbfbd1244b service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:12.846605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1119/2236] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:26:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 11:26:14.249120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421826b-9eb0-4ead-a3e1-a29db9976136 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:14.388265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421826b-9eb0-4ead-a3e1-a29db9976136 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:14.397763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:14.400582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:14.401256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:14.401878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] PATH_INFO: `/v3/users/a251a6945b2547bab1718157f333e48d` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:14.403831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a251a6945b2547bab1718157f333e48d)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:14.406401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:14.626611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:14.648877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a251a6945b2547bab1718157f333e48d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:14.755653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a251a6945b2547bab1718157f333e48d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:14.780121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a251a6945b2547bab1718157f333e48d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:14.816733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a251a6945b2547bab1718157f333e48d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:14.817591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fe1cc700-3471-4a80-81b9-093bdd43cf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a251a6945b2547bab1718157f333e48d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:14.821736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16281544-3843-4002-9470-e37db666cb3c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:14.822637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16281544-3843-4002-9470-e37db666cb3c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:14.823234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16281544-3843-4002-9470-e37db666cb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:14.861251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1118/2237] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:26:14 2022] DELETE /identity/v3/users/a251a6945b2547bab1718157f333e48d => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:26:14.861896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-16281544-3843-4002-9470-e37db666cb3c None None] MFA Rules not processed for user `bed04af5d690480e9739f3d87cabfadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:14.863428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16281544-3843-4002-9470-e37db666cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:14.865928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0dd5-9e4e-46c0-8897-66b2f2c1b820 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:14.866341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0dd5-9e4e-46c0-8897-66b2f2c1b820 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:14.866732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0dd5-9e4e-46c0-8897-66b2f2c1b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:14.944856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-13ea0dd5-9e4e-46c0-8897-66b2f2c1b820 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:14.950075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-13ea0dd5-9e4e-46c0-8897-66b2f2c1b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:15.037158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1120/2238] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:15.094349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1119/2239] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:15.135594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16281544-3843-4002-9470-e37db666cb3c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:15.137755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16281544-3843-4002-9470-e37db666cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:15.293614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16281544-3843-4002-9470-e37db666cb3c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:15.293614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e41c7-6132-4fe8-bfc8-0fe87e782b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:15.293614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e41c7-6132-4fe8-bfc8-0fe87e782b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:15.293614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e41c7-6132-4fe8-bfc8-0fe87e782b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:15.294004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e41c7-6132-4fe8-bfc8-0fe87e782b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:15.294004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e41c7-6132-4fe8-bfc8-0fe87e782b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:15.294004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e41c7-6132-4fe8-bfc8-0fe87e782b89 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:15.309687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1121/2240] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:16.507760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea0dd5-9e4e-46c0-8897-66b2f2c1b820 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:16.537013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-13ea0dd5-9e4e-46c0-8897-66b2f2c1b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:16.582341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea0dd5-9e4e-46c0-8897-66b2f2c1b820 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:16.612740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:16.614016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:16.614547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:16.615042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] PATH_INFO: `/v3/projects/0d7269cbfa5546148080988fca0697a2` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:16.616591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7269cbfa5546148080988fca0697a2)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:16.618809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:16.799264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7269cbfa5546148080988fca0697a2', 'request_id': 'req-72feffd0-76ee-48f9-a799-62d03705fa7a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:16.813881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7269cbfa5546148080988fca0697a2', 'request_id': 'req-72feffd0-76ee-48f9-a799-62d03705fa7a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:16.824159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7269cbfa5546148080988fca0697a2', 'request_id': 'req-72feffd0-76ee-48f9-a799-62d03705fa7a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:16.916096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] The token cache is being invalidate because project 0d7269cbfa5546148080988fca0697a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:26:16.917454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:16.922070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-72feffd0-76ee-48f9-a799-62d03705fa7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:16.925145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1120/2241] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:26:16 2022] DELETE /identity/v3/projects/0d7269cbfa5546148080988fca0697a2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:26:16.930051 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359b6f-3d75-42bf-b91a-bb9da5dff809 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:16.933377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359b6f-3d75-42bf-b91a-bb9da5dff809 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:16.933377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01359b6f-3d75-42bf-b91a-bb9da5dff809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:16.968262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-01359b6f-3d75-42bf-b91a-bb9da5dff809 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:16.970281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-01359b6f-3d75-42bf-b91a-bb9da5dff809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:17.040990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:17.072803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1122/2242] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:17.081697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919765e-2461-47cb-b89e-18e1f68ff7db None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:17.085704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919765e-2461-47cb-b89e-18e1f68ff7db None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:17.085704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919765e-2461-47cb-b89e-18e1f68ff7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:17.115093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-9919765e-2461-47cb-b89e-18e1f68ff7db None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:17.116793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9919765e-2461-47cb-b89e-18e1f68ff7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:17.130178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1121/2243] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:17.133123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01359b6f-3d75-42bf-b91a-bb9da5dff809 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:17.147871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01359b6f-3d75-42bf-b91a-bb9da5dff809 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:17.154927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:17.156168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:17.156643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:17.157216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:17.158471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:26:17.159033 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:17.161725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:17.177330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1123/2244] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:26:17.182112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919765e-2461-47cb-b89e-18e1f68ff7db None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:17.199809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919765e-2461-47cb-b89e-18e1f68ff7db None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:17.211937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908816f7-6c67-4e81-b835-9674cb3f5c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:17.212612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908816f7-6c67-4e81-b835-9674cb3f5c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:17.215072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908816f7-6c67-4e81-b835-9674cb3f5c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:17.215253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908816f7-6c67-4e81-b835-9674cb3f5c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:17.223315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908816f7-6c67-4e81-b835-9674cb3f5c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:17.226655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908816f7-6c67-4e81-b835-9674cb3f5c38 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:17.316975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1122/2245] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:26:17 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:26:17.321403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:17.334702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40a94a-7eec-4d0b-b4a9-7cd00fc0b0e0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:17.445849 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56beea2-025a-4db9-b657-099adaa903de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:17.446475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56beea2-025a-4db9-b657-099adaa903de admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:17.446751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56beea2-025a-4db9-b657-099adaa903de admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:17.447021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56beea2-025a-4db9-b657-099adaa903de admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:17.447713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56beea2-025a-4db9-b657-099adaa903de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:17.450306 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56beea2-025a-4db9-b657-099adaa903de admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:17.530393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1124/2246] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:26:17 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:26:17.534612 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908816f7-6c67-4e81-b835-9674cb3f5c38 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:17.540998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:17.550325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908816f7-6c67-4e81-b835-9674cb3f5c38 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:17.576753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde765c-42e5-455b-80dd-5f8c7625db8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:17.578580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde765c-42e5-455b-80dd-5f8c7625db8a admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:17.582670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde765c-42e5-455b-80dd-5f8c7625db8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:17.583078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde765c-42e5-455b-80dd-5f8c7625db8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:17.583864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde765c-42e5-455b-80dd-5f8c7625db8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:17.586232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde765c-42e5-455b-80dd-5f8c7625db8a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:17.605608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1123/2247] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:26:17.609553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56beea2-025a-4db9-b657-099adaa903de admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:17.621705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56beea2-025a-4db9-b657-099adaa903de admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:17.644668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fbc0e-cd45-40d9-aef8-ff73cc56c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:17.645242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fbc0e-cd45-40d9-aef8-ff73cc56c07e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:17.645523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fbc0e-cd45-40d9-aef8-ff73cc56c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:17.645804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fbc0e-cd45-40d9-aef8-ff73cc56c07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:17.646466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fbc0e-cd45-40d9-aef8-ff73cc56c07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:17.648102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fbc0e-cd45-40d9-aef8-ff73cc56c07e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:17.668710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1125/2248] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:26:17.670002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde765c-42e5-455b-80dd-5f8c7625db8a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:17.681948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde765c-42e5-455b-80dd-5f8c7625db8a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:17.691761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:17.693406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:17.693696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:17.694613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] PATH_INFO: `/v3/projects/6c91464d586e4526a0ab1bc2fcc708c7/users/37e5791b36b94d9cabed9441995bf4b4/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:17.731879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c91464d586e4526a0ab1bc2fcc708c7, user_id=37e5791b36b94d9cabed9441995bf4b4, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:17.735664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:17.810895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1124/2249] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:26:17 2022] PUT /identity/v3/projects/6c91464d586e4526a0ab1bc2fcc708c7/users/37e5791b36b94d9cabed9441995bf4b4/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:26:17.837007 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545f34d-2d91-49c2-86ca-c55d612f1cbe None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:17.837007 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545f34d-2d91-49c2-86ca-c55d612f1cbe None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:17.837859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545f34d-2d91-49c2-86ca-c55d612f1cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:17.911121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9545f34d-2d91-49c2-86ca-c55d612f1cbe None None] MFA Rules not processed for user `37e5791b36b94d9cabed9441995bf4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:17.917723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9545f34d-2d91-49c2-86ca-c55d612f1cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:18.052136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1126/2250] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:26:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:18.066972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:18.070148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:18.183326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfb21a-366a-4ca2-aa5f-081a70f903af admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:18.187277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac3391-2856-4a94-b7a1-f48c8ed7d8fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:18.187951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3391-2856-4a94-b7a1-f48c8ed7d8fd service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:18.188296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3391-2856-4a94-b7a1-f48c8ed7d8fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:18.188699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac3391-2856-4a94-b7a1-f48c8ed7d8fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:18.198670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac3391-2856-4a94-b7a1-f48c8ed7d8fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:18.200231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac3391-2856-4a94-b7a1-f48c8ed7d8fd service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:18.214420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1125/2251] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:24.687406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545f34d-2d91-49c2-86ca-c55d612f1cbe None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:24.795208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:24.850112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545f34d-2d91-49c2-86ca-c55d612f1cbe None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:24.857348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:24.861384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:24.861384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:24.861384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] PATH_INFO: `/v3/users/37e5791b36b94d9cabed9441995bf4b4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:24.861384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e5791b36b94d9cabed9441995bf4b4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:24.866623 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:25.039511 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e5791b36b94d9cabed9441995bf4b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:25.040758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e5791b36b94d9cabed9441995bf4b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:25.094970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e5791b36b94d9cabed9441995bf4b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:25.108489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e5791b36b94d9cabed9441995bf4b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:25.150174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e5791b36b94d9cabed9441995bf4b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:25.165892 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1127/2252] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:26:24 2022] DELETE /identity/v3/users/37e5791b36b94d9cabed9441995bf4b4 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:26:25.168591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cccbf-88a5-4ea9-a7c1-6fb550d100fd None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:25.172638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cccbf-88a5-4ea9-a7c1-6fb550d100fd None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:25.172638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cccbf-88a5-4ea9-a7c1-6fb550d100fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:25.227577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-788cccbf-88a5-4ea9-a7c1-6fb550d100fd None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:25.228850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-788cccbf-88a5-4ea9-a7c1-6fb550d100fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:25.477790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1126/2253] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:25.505969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:25.508088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:25.662838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7125f7b-bd4a-4090-aca0-5269ebca7253 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:25.666640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed54a2b-def5-4a2c-94c6-895c1054b2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:25.672240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed54a2b-def5-4a2c-94c6-895c1054b2db service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:25.672240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed54a2b-def5-4a2c-94c6-895c1054b2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:25.672240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed54a2b-def5-4a2c-94c6-895c1054b2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:25.695099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed54a2b-def5-4a2c-94c6-895c1054b2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:25.700616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed54a2b-def5-4a2c-94c6-895c1054b2db service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:25.719119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1128/2254] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:26.577056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cccbf-88a5-4ea9-a7c1-6fb550d100fd None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:26.578493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-788cccbf-88a5-4ea9-a7c1-6fb550d100fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:26.597653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cccbf-88a5-4ea9-a7c1-6fb550d100fd None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:26.604299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:26.604991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:26.605268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:26.605533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] PATH_INFO: `/v3/projects/6c91464d586e4526a0ab1bc2fcc708c7` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:26.607302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c91464d586e4526a0ab1bc2fcc708c7)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:26.609367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:26.748724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c91464d586e4526a0ab1bc2fcc708c7', 'request_id': 'req-aea84b9c-df3b-45f1-99d3-fbb899f23c66'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:26.772910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c91464d586e4526a0ab1bc2fcc708c7', 'request_id': 'req-aea84b9c-df3b-45f1-99d3-fbb899f23c66'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:26.805505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c91464d586e4526a0ab1bc2fcc708c7', 'request_id': 'req-aea84b9c-df3b-45f1-99d3-fbb899f23c66'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:26.807967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:26.865751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] The token cache is being invalidate because project 6c91464d586e4526a0ab1bc2fcc708c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:26:26.866339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:26.871346 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aea84b9c-df3b-45f1-99d3-fbb899f23c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:26.875415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1127/2255] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:26:26 2022] DELETE /identity/v3/projects/6c91464d586e4526a0ab1bc2fcc708c7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:26:32.020934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b7f7-fc88-4869-9186-4830bdfa31b0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:32.021517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b7f7-fc88-4869-9186-4830bdfa31b0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:32.022243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b7f7-fc88-4869-9186-4830bdfa31b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:32.051331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b8c7b7f7-fc88-4869-9186-4830bdfa31b0 None None] MFA Rules not processed for user `732e7072abde49de887256b43707c0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:32.053633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b8c7b7f7-fc88-4869-9186-4830bdfa31b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:32.171990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1129/2256] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:26:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:36.648663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebaefb-2550-4bfb-a983-5f67772274bc None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:36.649262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebaefb-2550-4bfb-a983-5f67772274bc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:36.649402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebaefb-2550-4bfb-a983-5f67772274bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:36.670278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-54ebaefb-2550-4bfb-a983-5f67772274bc None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:36.671532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-54ebaefb-2550-4bfb-a983-5f67772274bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:36.728927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1128/2257] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 11:26:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:36.743072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b7f7-fc88-4869-9186-4830bdfa31b0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:36.744530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b8c7b7f7-fc88-4869-9186-4830bdfa31b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:36.750259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:36.820979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b7f7-fc88-4869-9186-4830bdfa31b0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:36.829896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:36.830539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:36.830823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:36.831102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:36.840394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:36.842175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:36.851123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1130/2258] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:26:38.692773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8e37-35d0-44d8-a711-89e89b6420fa None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:38.693273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8e37-35d0-44d8-a711-89e89b6420fa None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:38.693398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e8e37-35d0-44d8-a711-89e89b6420fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:38.724029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a20e8e37-35d0-44d8-a711-89e89b6420fa None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:38.725302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a20e8e37-35d0-44d8-a711-89e89b6420fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:38.791902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1129/2259] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:38.821617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:38.823707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:38.922172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d523b41-a889-4bbb-a2aa-fe161790a8fb service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:38.929125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d52da-227d-4c61-a408-f636e8fcded1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:38.933220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d52da-227d-4c61-a408-f636e8fcded1 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:38.933628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d52da-227d-4c61-a408-f636e8fcded1 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:38.936698 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d52da-227d-4c61-a408-f636e8fcded1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:38.949576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d52da-227d-4c61-a408-f636e8fcded1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:38.951381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d52da-227d-4c61-a408-f636e8fcded1 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:38.962155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1131/2260] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:40.245147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e8e37-35d0-44d8-a711-89e89b6420fa None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:40.246641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a20e8e37-35d0-44d8-a711-89e89b6420fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:40.260043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e8e37-35d0-44d8-a711-89e89b6420fa None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:40.265566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:40.266236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:40.266515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:40.270897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] PATH_INFO: `/v3/users/91c4e4c7039a43129d9912ba4e69fbbd` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:40.270897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c4e4c7039a43129d9912ba4e69fbbd)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:40.270897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:40.420236 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c4e4c7039a43129d9912ba4e69fbbd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:40.459617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c4e4c7039a43129d9912ba4e69fbbd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:40.462790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c4e4c7039a43129d9912ba4e69fbbd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:40.483003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c4e4c7039a43129d9912ba4e69fbbd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:40.483895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-049c28d1-d7e5-4ffa-9a98-f040a0350e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c4e4c7039a43129d9912ba4e69fbbd'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:40.498051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1130/2261] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:26:40 2022] DELETE /identity/v3/users/91c4e4c7039a43129d9912ba4e69fbbd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:26:41.044681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d52da-227d-4c61-a408-f636e8fcded1 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:41.054793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d52da-227d-4c61-a408-f636e8fcded1 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:41.113139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:41.113771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:41.114051 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:41.114324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] PATH_INFO: `/v3/projects/6f08a72203844ed0b617bbc2ec85c5d5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:41.115427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f08a72203844ed0b617bbc2ec85c5d5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:41.117368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:41.139428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:41.200824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f08a72203844ed0b617bbc2ec85c5d5', 'request_id': 'req-4e232a55-e728-4c62-85ac-c2c7bc018259'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:41.211588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f08a72203844ed0b617bbc2ec85c5d5', 'request_id': 'req-4e232a55-e728-4c62-85ac-c2c7bc018259'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:41.218817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f08a72203844ed0b617bbc2ec85c5d5', 'request_id': 'req-4e232a55-e728-4c62-85ac-c2c7bc018259'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:41.283123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] The token cache is being invalidate because project 6f08a72203844ed0b617bbc2ec85c5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:26:41.283557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:41.284299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:26:41.286820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1132/2262] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:26:41 2022] DELETE /identity/v3/projects/6f08a72203844ed0b617bbc2ec85c5d5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:26:44.007813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099098e-387f-44ec-a068-5ff0d076384a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:44.008450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099098e-387f-44ec-a068-5ff0d076384a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:44.008450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099098e-387f-44ec-a068-5ff0d076384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:44.032409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e099098e-387f-44ec-a068-5ff0d076384a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:44.033643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e099098e-387f-44ec-a068-5ff0d076384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:44.038994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:44.094917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1131/2263] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:44.120921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:44.122311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:44.197599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e232a55-e728-4c62-85ac-c2c7bc018259 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:44.203745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:44.207036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:44.207036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:44.207036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:44.214251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:44.215851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:44.225698 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1133/2264] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:47.937569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516a3b3-2c5d-42eb-88dd-e57bbb104b45 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:47.938002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516a3b3-2c5d-42eb-88dd-e57bbb104b45 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:47.938099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516a3b3-2c5d-42eb-88dd-e57bbb104b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:47.957242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c516a3b3-2c5d-42eb-88dd-e57bbb104b45 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:47.958413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c516a3b3-2c5d-42eb-88dd-e57bbb104b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:47.966185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1132/2265] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:47.987971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:47.989403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:48.005517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85515a7b-72f6-44e6-a625-6d67abc3d015 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:48.011352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022628-70f6-47cf-af3f-de963e4e8f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:48.011991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022628-70f6-47cf-af3f-de963e4e8f11 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:48.012273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022628-70f6-47cf-af3f-de963e4e8f11 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:48.012576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022628-70f6-47cf-af3f-de963e4e8f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:48.021230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022628-70f6-47cf-af3f-de963e4e8f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:48.022800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022628-70f6-47cf-af3f-de963e4e8f11 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:48.033258 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1134/2266] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:52.195843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735547-05f4-4d3e-bfee-d4f097c992d5 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:52.196361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735547-05f4-4d3e-bfee-d4f097c992d5 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:52.196481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735547-05f4-4d3e-bfee-d4f097c992d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:52.216378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-be735547-05f4-4d3e-bfee-d4f097c992d5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:52.217558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-be735547-05f4-4d3e-bfee-d4f097c992d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:52.225246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1133/2267] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:26:52.272846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022628-70f6-47cf-af3f-de963e4e8f11 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:52.284524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022628-70f6-47cf-af3f-de963e4e8f11 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:52.289960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0156f-8366-4afd-a0c2-d78bbc04dc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:52.290578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0156f-8366-4afd-a0c2-d78bbc04dc4f service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:52.290861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0156f-8366-4afd-a0c2-d78bbc04dc4f service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:52.291132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0156f-8366-4afd-a0c2-d78bbc04dc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:52.299110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0156f-8366-4afd-a0c2-d78bbc04dc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:52.300712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0156f-8366-4afd-a0c2-d78bbc04dc4f service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:52.309994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1135/2268] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:26:56.466566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171d7b-563b-4fa2-b2e1-4823cd603971 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:56.467173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171d7b-563b-4fa2-b2e1-4823cd603971 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:56.467173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171d7b-563b-4fa2-b2e1-4823cd603971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:56.486803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-cb171d7b-563b-4fa2-b2e1-4823cd603971 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:26:56.487998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-cb171d7b-563b-4fa2-b2e1-4823cd603971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:26:56.496033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1134/2269] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 10 11:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:26:56.522563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0156f-8366-4afd-a0c2-d78bbc04dc4f service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:26:56.534225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0156f-8366-4afd-a0c2-d78bbc04dc4f service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:26:56.540018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:26:56.541141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:26:56.541141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:26:56.541352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:26:56.550092 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:26:56.551653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:26:56.560848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1136/2270] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:27:06.482060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=31 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:06.556732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:06.686440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d330-179b-4966-ac6b-3dcf3dc4977b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:06.686858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d330-179b-4966-ac6b-3dcf3dc4977b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:06.689121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d330-179b-4966-ac6b-3dcf3dc4977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:06.708331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-4301d330-179b-4966-ac6b-3dcf3dc4977b None None] MFA Rules not processed for user `d1bd70f21aed4b2bae45199a5901c00b`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:27:06.709559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4301d330-179b-4966-ac6b-3dcf3dc4977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:06.776638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1135/2271] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:27:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:27:16.781493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=25 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:34.060768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:34.062333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:34.075325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf5e9f-24b0-46e5-96ad-4822ec20af3c service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:34.080161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:34.081020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:34.081303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:34.081697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] PATH_INFO: `/v3/users/417c03798c594b2681776069f77bce5a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:34.082856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=417c03798c594b2681776069f77bce5a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:34.084802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:34.320626 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417c03798c594b2681776069f77bce5a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.321273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417c03798c594b2681776069f77bce5a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.403124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417c03798c594b2681776069f77bce5a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.411377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417c03798c594b2681776069f77bce5a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.425077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e68f3fa9-b440-4540-8545-85a8999672fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417c03798c594b2681776069f77bce5a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.431177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1137/2272] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:27:34 2022] DELETE /identity/v3/users/417c03798c594b2681776069f77bce5a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:27:34.679275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301d330-179b-4966-ac6b-3dcf3dc4977b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:34.691895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301d330-179b-4966-ac6b-3dcf3dc4977b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:34.755727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:34.756797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:34.756797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:34.757289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] PATH_INFO: `/v3/projects/8ed34b9416a54d559853c54a99d83d45` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:34.758118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed34b9416a54d559853c54a99d83d45)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:34.760050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:34.873264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed34b9416a54d559853c54a99d83d45', 'request_id': 'req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.890268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed34b9416a54d559853c54a99d83d45', 'request_id': 'req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.902035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed34b9416a54d559853c54a99d83d45', 'request_id': 'req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.976675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] The token cache is being invalidate because project 8ed34b9416a54d559853c54a99d83d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:27:34.976954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.977602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:34.979176 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1136/2273] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:27:34 2022] DELETE /identity/v3/projects/8ed34b9416a54d559853c54a99d83d45 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:27:34.985101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ae4f-1797-44ea-8762-e0364abeb659 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:34.985401 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ae4f-1797-44ea-8762-e0364abeb659 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:34.985727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ae4f-1797-44ea-8762-e0364abeb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.000141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:35.001823 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:35.024469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9f49ae4f-1797-44ea-8762-e0364abeb659 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:27:35.025725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9f49ae4f-1797-44ea-8762-e0364abeb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:35.086189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f113f15-5a53-4ab3-bf27-85bcc8a6f9d8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:35.092594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:35.093302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.093926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.107569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.112685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:35.116554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1138/2274] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:27:35.124585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0b6b-79e9-4ab6-a735-3981e5450fd7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.125270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0b6b-79e9-4ab6-a735-3981e5450fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.125705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0b6b-79e9-4ab6-a735-3981e5450fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.157314 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-004d0b6b-79e9-4ab6-a735-3981e5450fd7 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:27:35.159448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-004d0b6b-79e9-4ab6-a735-3981e5450fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:35.171899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1139/2275] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:27:35.189322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0b6b-79e9-4ab6-a735-3981e5450fd7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:35.203268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0b6b-79e9-4ab6-a735-3981e5450fd7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:35.211939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:35.213089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.213586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.214017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.215640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:27:35.216749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:35.219608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:35.226546 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:35.262410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1140/2276] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:27:35.267413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:35.289246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7d7d5-c91b-4d28-abb2-c513245c0788 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:35.290129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:35.294080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:35.295491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5feb3-8e12-4f44-b788-189894116be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:35.296113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5feb3-8e12-4f44-b788-189894116be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.296478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5feb3-8e12-4f44-b788-189894116be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.296752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5feb3-8e12-4f44-b788-189894116be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.297392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5feb3-8e12-4f44-b788-189894116be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:35.300133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5feb3-8e12-4f44-b788-189894116be4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:35.324734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1137/2277] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:27:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:27:35.441522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1141/2278] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:27:35 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:27:35.445869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:35.460174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2cb40-9f8c-42c2-bced-d33cacd114f2 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:35.557149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e7f5-999c-4c2c-bea9-0b0771aa9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:35.557702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e7f5-999c-4c2c-bea9-0b0771aa9d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.567330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e7f5-999c-4c2c-bea9-0b0771aa9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.567330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e7f5-999c-4c2c-bea9-0b0771aa9d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.567330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891e7f5-999c-4c2c-bea9-0b0771aa9d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:35.567330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891e7f5-999c-4c2c-bea9-0b0771aa9d88 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:35.660032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1138/2279] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:27:35 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:27:35.664930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5feb3-8e12-4f44-b788-189894116be4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:35.676348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5feb3-8e12-4f44-b788-189894116be4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:35.681851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d498-25b4-424f-b179-66eac4445d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:35.682554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d498-25b4-424f-b179-66eac4445d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.682899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d498-25b4-424f-b179-66eac4445d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.683247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d498-25b4-424f-b179-66eac4445d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.684146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d498-25b4-424f-b179-66eac4445d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:35.686299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d498-25b4-424f-b179-66eac4445d78 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:35.698307 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1142/2280] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:27:35.703298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e7f5-999c-4c2c-bea9-0b0771aa9d88 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:35.718838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e7f5-999c-4c2c-bea9-0b0771aa9d88 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:35.726816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4057-68ab-4513-9f34-56670dcc4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:35.726816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4057-68ab-4513-9f34-56670dcc4691 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.726816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4057-68ab-4513-9f34-56670dcc4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.726816 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4057-68ab-4513-9f34-56670dcc4691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.727571 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d4057-68ab-4513-9f34-56670dcc4691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:35.729889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d4057-68ab-4513-9f34-56670dcc4691 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:35.742309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1139/2281] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:27:35.748722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d498-25b4-424f-b179-66eac4445d78 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:35.757086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d498-25b4-424f-b179-66eac4445d78 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:35.761921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:35.762716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.763694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.764063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] PATH_INFO: `/v3/projects/433d402fa056433581fa056ec64c7c82/users/316e2243112b48f7b5ecf20fe11f9cf0/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.779446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433d402fa056433581fa056ec64c7c82, user_id=316e2243112b48f7b5ecf20fe11f9cf0, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:35.782221 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:35.787386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:35.851195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1143/2282] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:27:35 2022] PUT /identity/v3/projects/433d402fa056433581fa056ec64c7c82/users/316e2243112b48f7b5ecf20fe11f9cf0/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:27:35.862336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb245d27-3b42-4f94-b6d5-7ec28b3ccf57 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:35.862624 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb245d27-3b42-4f94-b6d5-7ec28b3ccf57 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:35.862896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb245d27-3b42-4f94-b6d5-7ec28b3ccf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:35.896926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-cb245d27-3b42-4f94-b6d5-7ec28b3ccf57 None None] MFA Rules not processed for user `316e2243112b48f7b5ecf20fe11f9cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:27:35.898381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-cb245d27-3b42-4f94-b6d5-7ec28b3ccf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:36.012071 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1140/2283] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:27:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:27:36.020124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:36.021886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:36.087845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb573bb-87f5-421f-82d5-6fc4011ec400 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:36.094929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb79df9-c030-462c-b390-3945ef72b900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:36.095617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb79df9-c030-462c-b390-3945ef72b900 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:36.095992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb79df9-c030-462c-b390-3945ef72b900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:36.096995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb79df9-c030-462c-b390-3945ef72b900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:36.108753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb79df9-c030-462c-b390-3945ef72b900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:36.112482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb79df9-c030-462c-b390-3945ef72b900 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:36.123959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1144/2284] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:27:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:27:36.598436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb245d27-3b42-4f94-b6d5-7ec28b3ccf57 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:36.600161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-cb245d27-3b42-4f94-b6d5-7ec28b3ccf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:36.682569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:36.704774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb245d27-3b42-4f94-b6d5-7ec28b3ccf57 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:36.708819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fc707-c307-4136-a33d-246aeeb03a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:36.709428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc707-c307-4136-a33d-246aeeb03a57 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:36.709779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc707-c307-4136-a33d-246aeeb03a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:36.710074 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fc707-c307-4136-a33d-246aeeb03a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:36.724365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-da2fc707-c307-4136-a33d-246aeeb03a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:36.844036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fc707-c307-4136-a33d-246aeeb03a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:36.858107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fc707-c307-4136-a33d-246aeeb03a57 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:36.878302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1141/2285] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:27:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:27:43.200286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee7c0c-3f5c-4ed1-baeb-600d462f1876 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:43.200885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee7c0c-3f5c-4ed1-baeb-600d462f1876 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:43.201205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee7c0c-3f5c-4ed1-baeb-600d462f1876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:43.221334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-01ee7c0c-3f5c-4ed1-baeb-600d462f1876 None None] MFA Rules not processed for user `9713207bf34847ae8faf498fc96061e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:27:43.222524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-01ee7c0c-3f5c-4ed1-baeb-600d462f1876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:43.280420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1145/2286] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:27:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:27:45.986139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf0648-e70e-49f5-a0e2-ec6f79cff0fa None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:45.986639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf0648-e70e-49f5-a0e2-ec6f79cff0fa None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:45.986740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf0648-e70e-49f5-a0e2-ec6f79cff0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:46.005821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-81bf0648-e70e-49f5-a0e2-ec6f79cff0fa None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:27:46.006994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-81bf0648-e70e-49f5-a0e2-ec6f79cff0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:46.064420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1142/2287] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 11:27:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:27:46.191103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee7c0c-3f5c-4ed1-baeb-600d462f1876 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:46.192667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-01ee7c0c-3f5c-4ed1-baeb-600d462f1876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:46.264555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee7c0c-3f5c-4ed1-baeb-600d462f1876 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:46.269970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804fb1a-3336-4428-a660-b6e3ef7709d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:46.270585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804fb1a-3336-4428-a660-b6e3ef7709d3 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:46.270859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804fb1a-3336-4428-a660-b6e3ef7709d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:46.271132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804fb1a-3336-4428-a660-b6e3ef7709d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:46.279783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804fb1a-3336-4428-a660-b6e3ef7709d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:46.281489 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804fb1a-3336-4428-a660-b6e3ef7709d3 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:46.289508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1146/2288] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:27:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:27:47.014444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf0648-e70e-49f5-a0e2-ec6f79cff0fa None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:47.024973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf0648-e70e-49f5-a0e2-ec6f79cff0fa None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:47.029831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3620df-55b1-41b7-8963-2ce8555312b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:47.030693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3620df-55b1-41b7-8963-2ce8555312b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:47.031075 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3620df-55b1-41b7-8963-2ce8555312b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:47.031349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3620df-55b1-41b7-8963-2ce8555312b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:47.033212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8a3620df-55b1-41b7-8963-2ce8555312b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:47.044732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3620df-55b1-41b7-8963-2ce8555312b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:47.048218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3620df-55b1-41b7-8963-2ce8555312b4 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:47.055802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1143/2289] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:27:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:27:48.070909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804fb1a-3336-4428-a660-b6e3ef7709d3 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:48.111276 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:48.147895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804fb1a-3336-4428-a660-b6e3ef7709d3 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:48.150210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:48.151016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:48.151295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:48.151807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] PATH_INFO: `/v3/users/316e2243112b48f7b5ecf20fe11f9cf0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:48.154240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=316e2243112b48f7b5ecf20fe11f9cf0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:48.156329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:48.304038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316e2243112b48f7b5ecf20fe11f9cf0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:48.304768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316e2243112b48f7b5ecf20fe11f9cf0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:48.375079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316e2243112b48f7b5ecf20fe11f9cf0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:48.383722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316e2243112b48f7b5ecf20fe11f9cf0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:48.397354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316e2243112b48f7b5ecf20fe11f9cf0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:48.403833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1147/2290] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:27:48 2022] DELETE /identity/v3/users/316e2243112b48f7b5ecf20fe11f9cf0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:27:48.408606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4196-086d-418a-8a7a-2bb43ac3fc97 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:48.409111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4196-086d-418a-8a7a-2bb43ac3fc97 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:48.409286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4196-086d-418a-8a7a-2bb43ac3fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:48.428731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-890c4196-086d-418a-8a7a-2bb43ac3fc97 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:27:48.430061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-890c4196-086d-418a-8a7a-2bb43ac3fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:48.494485 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1144/2291] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:27:48.504999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:48.507080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:48.576061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715f03-a619-4245-9295-64a9f74cb0bc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:48.580721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:48.581940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:48.582299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:48.582651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:48.593536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:48.595076 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:48.605267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1148/2292] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:27:49.179432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4196-086d-418a-8a7a-2bb43ac3fc97 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:49.185954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-890c4196-086d-418a-8a7a-2bb43ac3fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:49.205109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4196-086d-418a-8a7a-2bb43ac3fc97 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:49.215253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:49.216580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:49.217037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:49.217518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] PATH_INFO: `/v3/projects/433d402fa056433581fa056ec64c7c82` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:49.219174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=433d402fa056433581fa056ec64c7c82)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:49.222643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:49.232537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:49.343365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433d402fa056433581fa056ec64c7c82', 'request_id': 'req-29765a5a-2827-47bb-9d10-50d0f1d81598'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:49.350116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433d402fa056433581fa056ec64c7c82', 'request_id': 'req-29765a5a-2827-47bb-9d10-50d0f1d81598'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:49.355811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433d402fa056433581fa056ec64c7c82', 'request_id': 'req-29765a5a-2827-47bb-9d10-50d0f1d81598'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:49.431557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] The token cache is being invalidate because project 433d402fa056433581fa056ec64c7c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:27:49.432240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:49.432608 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29765a5a-2827-47bb-9d10-50d0f1d81598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:49.434134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1145/2293] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:27:49 2022] DELETE /identity/v3/projects/433d402fa056433581fa056ec64c7c82 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:27:51.182417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:51.183992 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:51.242571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc25836-549c-48dd-9e14-edc89d855caf service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:51.254284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:51.295058 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:51.296765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:51.296765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:51.296765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:51.298354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:51.360426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:51.361768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:51.374222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1149/2294] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:27:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:27:55.228220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775341-55a4-432b-9c81-40d12f021c6d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:55.228845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775341-55a4-432b-9c81-40d12f021c6d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:55.228845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775341-55a4-432b-9c81-40d12f021c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:55.249044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-85775341-55a4-432b-9c81-40d12f021c6d None None] MFA Rules not processed for user `bed04af5d690480e9739f3d87cabfadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:27:55.250613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-85775341-55a4-432b-9c81-40d12f021c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:55.318837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1146/2295] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:27:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:27:57.213916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:57.213916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:57.281293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4bf18-0cfd-4f24-9d04-c459ffb71361 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:57.285804 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:57.286461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:57.286745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:57.287038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] PATH_INFO: `/v3/users/a5bfdee7f3214a2d893bdfd5cdf210f8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:57.288167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bfdee7f3214a2d893bdfd5cdf210f8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:57.290109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:57.468984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bfdee7f3214a2d893bdfd5cdf210f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:57.469648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bfdee7f3214a2d893bdfd5cdf210f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:57.552106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bfdee7f3214a2d893bdfd5cdf210f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:57.560010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bfdee7f3214a2d893bdfd5cdf210f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:57.564533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:57.572251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bfdee7f3214a2d893bdfd5cdf210f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:57.578173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1150/2296] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:27:57 2022] DELETE /identity/v3/users/a5bfdee7f3214a2d893bdfd5cdf210f8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:27:57.881091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85775341-55a4-432b-9c81-40d12f021c6d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:57.893262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85775341-55a4-432b-9c81-40d12f021c6d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:57.949210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:57.950458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:57.950742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:57.951016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] PATH_INFO: `/v3/projects/af1f7aa5085a4d6698e40725be9e46b3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:57.952128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1f7aa5085a4d6698e40725be9e46b3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:57.954060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:58.065860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:58.069706 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1f7aa5085a4d6698e40725be9e46b3', 'request_id': 'req-b06bba24-56d6-44c3-be47-6ad40eed247c'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.076842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1f7aa5085a4d6698e40725be9e46b3', 'request_id': 'req-b06bba24-56d6-44c3-be47-6ad40eed247c'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.083758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1f7aa5085a4d6698e40725be9e46b3', 'request_id': 'req-b06bba24-56d6-44c3-be47-6ad40eed247c'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.186388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] The token cache is being invalidate because project af1f7aa5085a4d6698e40725be9e46b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:27:58.186691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.187352 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.188969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1147/2297] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:27:57 2022] DELETE /identity/v3/projects/af1f7aa5085a4d6698e40725be9e46b3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:27:58.192998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:58.194422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:58.210652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4527c-8370-4e43-8e5a-986a4aff220b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:58.272875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:58.273549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:58.273785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:58.274061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] PATH_INFO: `/v3/users/ea079f382b6f4afcb3fc5345ca9a2bb8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:58.275294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea079f382b6f4afcb3fc5345ca9a2bb8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:58.277288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:58.457572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea079f382b6f4afcb3fc5345ca9a2bb8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.458211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea079f382b6f4afcb3fc5345ca9a2bb8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.534772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea079f382b6f4afcb3fc5345ca9a2bb8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.543072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea079f382b6f4afcb3fc5345ca9a2bb8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.555866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea079f382b6f4afcb3fc5345ca9a2bb8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:58.562966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1151/2298] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:27:58 2022] DELETE /identity/v3/users/ea079f382b6f4afcb3fc5345ca9a2bb8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:27:58.807428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:27:58.807562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:27:58.823743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bba24-56d6-44c3-be47-6ad40eed247c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:27:58.882017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:27:58.882694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:27:58.882934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:27:58.883201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] PATH_INFO: `/v3/projects/b10d977e29df452fa7531c0452ea2066` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:27:58.884314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10d977e29df452fa7531c0452ea2066)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:27:58.886213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:27:58.998881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10d977e29df452fa7531c0452ea2066', 'request_id': 'req-293c8820-bedb-4813-86a1-86a51bc05b42'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:59.004962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10d977e29df452fa7531c0452ea2066', 'request_id': 'req-293c8820-bedb-4813-86a1-86a51bc05b42'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:59.010529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10d977e29df452fa7531c0452ea2066', 'request_id': 'req-293c8820-bedb-4813-86a1-86a51bc05b42'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:59.095439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] The token cache is being invalidate because project b10d977e29df452fa7531c0452ea2066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:27:59.095853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:59.096558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-293c8820-bedb-4813-86a1-86a51bc05b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:27:59.098097 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1148/2299] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:27:58 2022] DELETE /identity/v3/projects/b10d977e29df452fa7531c0452ea2066 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:28:05.123845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:05.125864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:05.230219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c996d-b355-4de0-965f-4b7160bb3085 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:05.250959 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:05.290866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:05.291484 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:05.291763 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:05.292039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:05.293825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:05.306420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:05.308594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:05.320395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1152/2300] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:07.953850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc7f5-79ea-417e-ac6d-99288f5387d3 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:07.954401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc7f5-79ea-417e-ac6d-99288f5387d3 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:07.954401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc7f5-79ea-417e-ac6d-99288f5387d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:07.973755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-721cc7f5-79ea-417e-ac6d-99288f5387d3 None None] MFA Rules not processed for user `732e7072abde49de887256b43707c0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:28:07.974887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-721cc7f5-79ea-417e-ac6d-99288f5387d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:08.029222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1149/2301] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:28:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:28:08.341008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:08.342590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:08.352640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98bfec-2735-4684-8902-f46d67aa13a7 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:08.356205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:08.356829 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:08.357632 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:08.357994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:08.359727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:08.368686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:08.370072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:08.378682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1153/2302] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:08.781845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cc7f5-79ea-417e-ac6d-99288f5387d3 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:08.783368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-721cc7f5-79ea-417e-ac6d-99288f5387d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:08.795627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:08.861569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cc7f5-79ea-417e-ac6d-99288f5387d3 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:08.866400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:08.866994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:08.867270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:08.867538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:08.869380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:08.880913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:08.882481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:08.892060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1150/2303] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:09.899859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:09.901398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:09.976569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d093d4-54bc-4261-a345-db8c702e363f service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:09.981991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf26d41-dc0c-480d-8e07-9cf5f656f2a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:09.982596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26d41-dc0c-480d-8e07-9cf5f656f2a0 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:09.982876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26d41-dc0c-480d-8e07-9cf5f656f2a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:09.983696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26d41-dc0c-480d-8e07-9cf5f656f2a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:09.985490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bcf26d41-dc0c-480d-8e07-9cf5f656f2a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:10.046916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf26d41-dc0c-480d-8e07-9cf5f656f2a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:10.048572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf26d41-dc0c-480d-8e07-9cf5f656f2a0 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:10.057522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1154/2304] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:12.406728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:12.419274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0496fa-42f2-4b60-bfe2-c15ea015aa6c service placement] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:12.425127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:12.425726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:12.426002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:12.426275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:12.428009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:12.447846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:12.449668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:12.461427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1151/2305] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:20.053280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=79 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:22.456702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=35 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:31.053176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e70e-a15a-4d1c-9742-65bcdffaf796 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:31.053780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e70e-a15a-4d1c-9742-65bcdffaf796 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:31.053780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288e70e-a15a-4d1c-9742-65bcdffaf796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:31.073532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d288e70e-a15a-4d1c-9742-65bcdffaf796 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:28:31.074741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d288e70e-a15a-4d1c-9742-65bcdffaf796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:31.131358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1155/2306] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:28:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:28:31.143443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:31.145216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:31.220342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c54a9-4a89-478c-a1b8-1dd173fc83ee service nova] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:31.225266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00617bb-b4eb-48dd-ab68-de2031338a3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:31.225869 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00617bb-b4eb-48dd-ab68-de2031338a3b service swift] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:31.226139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00617bb-b4eb-48dd-ab68-de2031338a3b service swift] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:31.226415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00617bb-b4eb-48dd-ab68-de2031338a3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:31.234330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00617bb-b4eb-48dd-ab68-de2031338a3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:31.235898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00617bb-b4eb-48dd-ab68-de2031338a3b service swift] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:31.243909 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1152/2307] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:28:32.762432 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288e70e-a15a-4d1c-9742-65bcdffaf796 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:32.763933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d288e70e-a15a-4d1c-9742-65bcdffaf796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:32.784319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288e70e-a15a-4d1c-9742-65bcdffaf796 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:32.789887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c96ef-096e-4d17-94ce-96939b26e3c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:32.790512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c96ef-096e-4d17-94ce-96939b26e3c3 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:32.790786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c96ef-096e-4d17-94ce-96939b26e3c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:32.791052 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c96ef-096e-4d17-94ce-96939b26e3c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:32.793186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-648c96ef-096e-4d17-94ce-96939b26e3c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:32.805869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c96ef-096e-4d17-94ce-96939b26e3c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:32.808668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c96ef-096e-4d17-94ce-96939b26e3c3 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:32.838921 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1156/2308] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:41.240709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=32 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:42.831841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=31 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:53.568266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab8c50-6eba-4e39-99e7-278bc2d88ee6 None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:53.569989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab8c50-6eba-4e39-99e7-278bc2d88ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:53.570339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab8c50-6eba-4e39-99e7-278bc2d88ee6 None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:53.572037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1153/2309] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:28:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:28:53.578761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e084b4a-784b-4fde-811d-4e9574e81ef9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:53.580441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e084b4a-784b-4fde-811d-4e9574e81ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:53.581118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e084b4a-784b-4fde-811d-4e9574e81ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:53.604964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0e084b4a-784b-4fde-811d-4e9574e81ef9 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:28:53.606233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0e084b4a-784b-4fde-811d-4e9574e81ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:53.615609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1157/2310] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:28:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:28:53.629420 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab8c50-6eba-4e39-99e7-278bc2d88ee6 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:53.631129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0dab8c50-6eba-4e39-99e7-278bc2d88ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:53.696140 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab8c50-6eba-4e39-99e7-278bc2d88ee6 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:53.699745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8395d-a420-48a8-9394-807c5dbbeb37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc7327f524a450e8429b5008166e5d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:53.700377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8395d-a420-48a8-9394-807c5dbbeb37 service glance] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:53.700661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8395d-a420-48a8-9394-807c5dbbeb37 service glance] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:53.700933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8395d-a420-48a8-9394-807c5dbbeb37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:53.713226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8395d-a420-48a8-9394-807c5dbbeb37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:53.714788 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8395d-a420-48a8-9394-807c5dbbeb37 service glance] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:53.726960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1154/2311] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:53.950493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf429d-aa27-4792-b174-38b89a08a6fc None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:53.950493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf429d-aa27-4792-b174-38b89a08a6fc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:53.950493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf429d-aa27-4792-b174-38b89a08a6fc None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:53.950493 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1158/2312] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:28:53.955016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01892-6e93-4ab5-b995-035d152839ac None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:53.955308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01892-6e93-4ab5-b995-035d152839ac None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:53.955607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01892-6e93-4ab5-b995-035d152839ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:53.975310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-abd01892-6e93-4ab5-b995-035d152839ac None None] MFA Rules not processed for user `512aab5a19c94651bfa0f634244dbdab`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:28:53.979214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-abd01892-6e93-4ab5-b995-035d152839ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:53.983032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1155/2313] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:28:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:28:53.996088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf429d-aa27-4792-b174-38b89a08a6fc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:54.007875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf429d-aa27-4792-b174-38b89a08a6fc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:54.013602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55825a6e-049d-436c-9c0c-cab0fc50fccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:54.013602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55825a6e-049d-436c-9c0c-cab0fc50fccc service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:54.013602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55825a6e-049d-436c-9c0c-cab0fc50fccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:54.013602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55825a6e-049d-436c-9c0c-cab0fc50fccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:54.020181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55825a6e-049d-436c-9c0c-cab0fc50fccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:54.021694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55825a6e-049d-436c-9c0c-cab0fc50fccc service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:54.029717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1159/2314] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:54.113765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78353-129a-46dc-ad54-2f98901d6fce None None] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:54.121325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78353-129a-46dc-ad54-2f98901d6fce None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:54.121325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78353-129a-46dc-ad54-2f98901d6fce None None] PATH_INFO: `/` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:54.121325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1156/2315] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 10 11:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 11:28:54.121695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783f9bd-d3a3-42e0-b87e-fd8ead6c9053 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:54.121695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783f9bd-d3a3-42e0-b87e-fd8ead6c9053 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:54.121695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783f9bd-d3a3-42e0-b87e-fd8ead6c9053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:54.140775 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b783f9bd-d3a3-42e0-b87e-fd8ead6c9053 None None] MFA Rules not processed for user `e64f4c342e714597b6c628ca022d7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:28:54.141968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b783f9bd-d3a3-42e0-b87e-fd8ead6c9053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:54.151478 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1160/2316] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 10 11:28:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:28:54.162483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e78353-129a-46dc-ad54-2f98901d6fce None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:54.178586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e78353-129a-46dc-ad54-2f98901d6fce None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:54.178586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4837c5-519e-435f-b080-a7d45d7f804e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:54.178586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4837c5-519e-435f-b080-a7d45d7f804e service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:54.178586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4837c5-519e-435f-b080-a7d45d7f804e service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:54.179034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4837c5-519e-435f-b080-a7d45d7f804e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:54.191239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4837c5-519e-435f-b080-a7d45d7f804e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:54.192694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4837c5-519e-435f-b080-a7d45d7f804e service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:54.207318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1157/2317] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:58.651004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783f9bd-d3a3-42e0-b87e-fd8ead6c9053 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:58.691007 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783f9bd-d3a3-42e0-b87e-fd8ead6c9053 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:58.698355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02ea96-71b8-42d5-83df-a61a6afa4d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:58.699230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02ea96-71b8-42d5-83df-a61a6afa4d61 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:58.699659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02ea96-71b8-42d5-83df-a61a6afa4d61 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:58.700105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02ea96-71b8-42d5-83df-a61a6afa4d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:58.702171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ec02ea96-71b8-42d5-83df-a61a6afa4d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:58.737579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02ea96-71b8-42d5-83df-a61a6afa4d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:58.742459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02ea96-71b8-42d5-83df-a61a6afa4d61 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:58.751917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1161/2318] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:28:59.698098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4837c5-519e-435f-b080-a7d45d7f804e service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:28:59.709414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4837c5-519e-435f-b080-a7d45d7f804e service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:28:59.714769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:28:59.715383 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:28:59.715658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:28:59.715927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:28:59.717637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:28:59.777367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:28:59.778933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:28:59.788552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1158/2319] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:28:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:00.104619 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56be3a6-ee17-47ce-871b-b614edb79bfd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:00.107609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56be3a6-ee17-47ce-871b-b614edb79bfd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:00.107609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56be3a6-ee17-47ce-871b-b614edb79bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:00.123927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b56be3a6-ee17-47ce-871b-b614edb79bfd None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:00.125194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b56be3a6-ee17-47ce-871b-b614edb79bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:00.132380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1162/2320] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:29:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:00.154278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:00.166400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7d61b-586d-4e9e-8d5e-b49d2e95f115 service nova] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:00.171366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b916b6-9f48-407c-b9b8-93eb0136db23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:00.171966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b916b6-9f48-407c-b9b8-93eb0136db23 service swift] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:00.172245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b916b6-9f48-407c-b9b8-93eb0136db23 service swift] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:00.172644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b916b6-9f48-407c-b9b8-93eb0136db23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:00.181270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b916b6-9f48-407c-b9b8-93eb0136db23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:00.182873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b916b6-9f48-407c-b9b8-93eb0136db23 service swift] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:00.190952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1159/2321] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:29:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:29:10.119108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=21 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:10.187558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=69 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:18.932831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56be3a6-ee17-47ce-871b-b614edb79bfd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:18.952124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56be3a6-ee17-47ce-871b-b614edb79bfd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:18.957406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:18.958391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:18.958865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:18.959437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:18.962012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:18.983947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0f6a4-be30-4230-b3bc-514af1ef7775 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:18.983947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0f6a4-be30-4230-b3bc-514af1ef7775 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:18.983947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0f6a4-be30-4230-b3bc-514af1ef7775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:19.021244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f7c0f6a4-be30-4230-b3bc-514af1ef7775 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:19.022923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f7c0f6a4-be30-4230-b3bc-514af1ef7775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:19.031382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1160/2322] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 11:29:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:19.046500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0f6a4-be30-4230-b3bc-514af1ef7775 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:19.054561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:19.058427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:19.063376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0f6a4-be30-4230-b3bc-514af1ef7775 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:19.068416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1163/2323] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:19.071178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d3a4b-e6f0-479a-b703-290f6168baa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:19.071801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3a4b-e6f0-479a-b703-290f6168baa5 service swift] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:19.072083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3a4b-e6f0-479a-b703-290f6168baa5 service swift] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:19.072389 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d3a4b-e6f0-479a-b703-290f6168baa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:19.086158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d3a4b-e6f0-479a-b703-290f6168baa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:19.086158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d3a4b-e6f0-479a-b703-290f6168baa5 service swift] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:19.100684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1161/2324] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:29:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 11:29:23.721721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:23.723227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:23.735166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3f842-388d-47b2-aaeb-fbdc77f78a43 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:23.740124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:23.740818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:23.741213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:23.741350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] PATH_INFO: `/v3/users/bed04af5d690480e9739f3d87cabfadf` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:23.742799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed04af5d690480e9739f3d87cabfadf)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:23.744749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:23.953964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed04af5d690480e9739f3d87cabfadf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:23.954848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed04af5d690480e9739f3d87cabfadf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.075018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed04af5d690480e9739f3d87cabfadf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.080439 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed04af5d690480e9739f3d87cabfadf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.099191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bc9eb762-c533-41d9-8458-ea61b4944123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed04af5d690480e9739f3d87cabfadf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.110645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1164/2325] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:23 2022] DELETE /identity/v3/users/bed04af5d690480e9739f3d87cabfadf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:24.380871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d3a4b-e6f0-479a-b703-290f6168baa5 service swift] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:24.393318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d3a4b-e6f0-479a-b703-290f6168baa5 service swift] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:24.459281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:24.460083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:24.460514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:24.460794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] PATH_INFO: `/v3/projects/7b55585d971049c38381d4d9a3ca8222` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:24.461957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b55585d971049c38381d4d9a3ca8222)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:24.464068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:24.581361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b55585d971049c38381d4d9a3ca8222', 'request_id': 'req-9a429457-9bc7-4c90-982a-686148201b23'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.587533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b55585d971049c38381d4d9a3ca8222', 'request_id': 'req-9a429457-9bc7-4c90-982a-686148201b23'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.593000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b55585d971049c38381d4d9a3ca8222', 'request_id': 'req-9a429457-9bc7-4c90-982a-686148201b23'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.682230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] The token cache is being invalidate because project 7b55585d971049c38381d4d9a3ca8222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:24.682629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.683442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9a429457-9bc7-4c90-982a-686148201b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:24.685333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1162/2326] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:24 2022] DELETE /identity/v3/projects/7b55585d971049c38381d4d9a3ca8222 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:24.690879 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8d92-2c5a-4fab-b276-121799e28df3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:24.691522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8d92-2c5a-4fab-b276-121799e28df3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:24.692005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b8d92-2c5a-4fab-b276-121799e28df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:24.743569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a03b8d92-2c5a-4fab-b276-121799e28df3 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:24.752605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a03b8d92-2c5a-4fab-b276-121799e28df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:24.840343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1165/2327] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:24.850655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24af84-0400-488f-9e46-88283954c1d9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:24.850655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24af84-0400-488f-9e46-88283954c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:24.850655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24af84-0400-488f-9e46-88283954c1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:24.868809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-7d24af84-0400-488f-9e46-88283954c1d9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:24.870013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7d24af84-0400-488f-9e46-88283954c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:24.878791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1163/2328] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:24.882634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8d92-2c5a-4fab-b276-121799e28df3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:24.893650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b8d92-2c5a-4fab-b276-121799e28df3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:24.898912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:24.899538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:24.901899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:24.901899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:24.901899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:24.901899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:24.902934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:24.904908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:24.917101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1166/2329] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:29:24.921515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24af84-0400-488f-9e46-88283954c1d9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:24.934178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24af84-0400-488f-9e46-88283954c1d9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:24.945508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b222313-189c-4901-8195-6a6d6b3d418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:24.946255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b222313-189c-4901-8195-6a6d6b3d418c admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:24.946638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b222313-189c-4901-8195-6a6d6b3d418c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:24.947024 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b222313-189c-4901-8195-6a6d6b3d418c admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:24.947913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b222313-189c-4901-8195-6a6d6b3d418c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:24.950125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b222313-189c-4901-8195-6a6d6b3d418c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:25.052718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1164/2330] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:24 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:25.056894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:25.067670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7505530-8dd4-4552-b899-d7425e6d36d5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:25.124617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841efd4c-635a-4bad-b2a5-cca877e1e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:25.125554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841efd4c-635a-4bad-b2a5-cca877e1e742 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.125834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841efd4c-635a-4bad-b2a5-cca877e1e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.126183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841efd4c-635a-4bad-b2a5-cca877e1e742 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.127451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841efd4c-635a-4bad-b2a5-cca877e1e742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:25.130196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841efd4c-635a-4bad-b2a5-cca877e1e742 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:25.196418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1167/2331] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:25 2022] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:25.199727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b222313-189c-4901-8195-6a6d6b3d418c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:25.209282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b222313-189c-4901-8195-6a6d6b3d418c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:25.213874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cc9e-6fca-4b24-99d6-12b770131464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:25.214457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cc9e-6fca-4b24-99d6-12b770131464 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.214726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cc9e-6fca-4b24-99d6-12b770131464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.214986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cc9e-6fca-4b24-99d6-12b770131464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.215626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5cc9e-6fca-4b24-99d6-12b770131464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:25.217228 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5cc9e-6fca-4b24-99d6-12b770131464 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:25.227358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1165/2332] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:25.231528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841efd4c-635a-4bad-b2a5-cca877e1e742 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:25.242884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841efd4c-635a-4bad-b2a5-cca877e1e742 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:25.247614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78abca-6ad4-450f-9436-c18ead559d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:25.248243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78abca-6ad4-450f-9436-c18ead559d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.248554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78abca-6ad4-450f-9436-c18ead559d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.248827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78abca-6ad4-450f-9436-c18ead559d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.249479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78abca-6ad4-450f-9436-c18ead559d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:25.251087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78abca-6ad4-450f-9436-c18ead559d9a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:25.262610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1168/2333] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:25.266811 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cc9e-6fca-4b24-99d6-12b770131464 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:25.277385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cc9e-6fca-4b24-99d6-12b770131464 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:25.282012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f335370-b0e2-4c90-b9d8-dcbd5e78362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:25.284836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335370-b0e2-4c90-b9d8-dcbd5e78362a admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.284836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335370-b0e2-4c90-b9d8-dcbd5e78362a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.284836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335370-b0e2-4c90-b9d8-dcbd5e78362a admin admin] PATH_INFO: `/v3/projects/d980cbed94c447e2abd8ccd20bc1ecd5/users/b0f69220c7a9431ba215b071f5d8c58a/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.297563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f335370-b0e2-4c90-b9d8-dcbd5e78362a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d980cbed94c447e2abd8ccd20bc1ecd5, user_id=b0f69220c7a9431ba215b071f5d8c58a, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:25.300797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f335370-b0e2-4c90-b9d8-dcbd5e78362a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:25.353308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1166/2334] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:25 2022] PUT /identity/v3/projects/d980cbed94c447e2abd8ccd20bc1ecd5/users/b0f69220c7a9431ba215b071f5d8c58a/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:25.365502 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea516-9428-4a44-addf-f7341fb3f6d6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.365794 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea516-9428-4a44-addf-f7341fb3f6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.366074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea516-9428-4a44-addf-f7341fb3f6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.395079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-307ea516-9428-4a44-addf-f7341fb3f6d6 None None] MFA Rules not processed for user `b0f69220c7a9431ba215b071f5d8c58a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:25.396564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-307ea516-9428-4a44-addf-f7341fb3f6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:25.466129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1169/2335] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:25 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:25.470511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f335370-b0e2-4c90-b9d8-dcbd5e78362a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:25.479385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:25.532587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f335370-b0e2-4c90-b9d8-dcbd5e78362a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:25.537433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bb207-8fda-411b-85f4-d1144c330908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:25.538032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bb207-8fda-411b-85f4-d1144c330908 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.538313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bb207-8fda-411b-85f4-d1144c330908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.538587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bb207-8fda-411b-85f4-d1144c330908 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.539221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bb207-8fda-411b-85f4-d1144c330908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:25.541145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bb207-8fda-411b-85f4-d1144c330908 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:25.656782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1167/2336] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:25 2022] POST /identity/v3/projects => generated 405 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:25.660800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ea516-9428-4a44-addf-f7341fb3f6d6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:25.671735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ea516-9428-4a44-addf-f7341fb3f6d6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:25.729426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8a6ab-3e37-4d70-b865-0c2f08a4f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:25.729974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a6ab-3e37-4d70-b865-0c2f08a4f512 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.730255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a6ab-3e37-4d70-b865-0c2f08a4f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.730531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8a6ab-3e37-4d70-b865-0c2f08a4f512 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.731255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8a6ab-3e37-4d70-b865-0c2f08a4f512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:25.733324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8a6ab-3e37-4d70-b865-0c2f08a4f512 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:25.742723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:25.833251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1170/2337] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:25 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:25.837037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bb207-8fda-411b-85f4-d1144c330908 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:25.848524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bb207-8fda-411b-85f4-d1144c330908 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:25.854388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a5ff-db82-4565-ac2c-fa111b50fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:25.855006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a5ff-db82-4565-ac2c-fa111b50fc1f admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.855282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a5ff-db82-4565-ac2c-fa111b50fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.855747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a5ff-db82-4565-ac2c-fa111b50fc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.856732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0a5ff-db82-4565-ac2c-fa111b50fc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:25.858270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0a5ff-db82-4565-ac2c-fa111b50fc1f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:25.874671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1168/2338] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:25.875798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8a6ab-3e37-4d70-b865-0c2f08a4f512 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:25.891670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8a6ab-3e37-4d70-b865-0c2f08a4f512 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:25.897504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8ef7-af94-49b2-a6f7-e97997ed52e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:25.898831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8ef7-af94-49b2-a6f7-e97997ed52e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:25.899114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8ef7-af94-49b2-a6f7-e97997ed52e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:25.899390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8ef7-af94-49b2-a6f7-e97997ed52e4 admin admin] PATH_INFO: `/v3/projects/5fc3a020c4b84735bc00889438056825/users/ff9cc6bfcc944e9cab7f1fa78dfc53fe/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:25.915750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8ef7-af94-49b2-a6f7-e97997ed52e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc3a020c4b84735bc00889438056825, user_id=ff9cc6bfcc944e9cab7f1fa78dfc53fe, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:25.920673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8ef7-af94-49b2-a6f7-e97997ed52e4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:26.050385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1171/2339] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:25 2022] PUT /identity/v3/projects/5fc3a020c4b84735bc00889438056825/users/ff9cc6bfcc944e9cab7f1fa78dfc53fe/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:26.054370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a5ff-db82-4565-ac2c-fa111b50fc1f admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:26.065170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a5ff-db82-4565-ac2c-fa111b50fc1f admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:26.121912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10b96-19b3-4b63-8b93-3f3215318288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:26.122541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10b96-19b3-4b63-8b93-3f3215318288 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:26.122844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10b96-19b3-4b63-8b93-3f3215318288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:26.123112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10b96-19b3-4b63-8b93-3f3215318288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:26.123753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10b96-19b3-4b63-8b93-3f3215318288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:26.125372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10b96-19b3-4b63-8b93-3f3215318288 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:26.135492 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1169/2340] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:26.139726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8ef7-af94-49b2-a6f7-e97997ed52e4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:26.151499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8ef7-af94-49b2-a6f7-e97997ed52e4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:26.156122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:26.156802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:26.157104 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:26.157360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] PATH_INFO: `/v3/projects/5fc3a020c4b84735bc00889438056825/users/ff9cc6bfcc944e9cab7f1fa78dfc53fe/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:26.159743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc3a020c4b84735bc00889438056825, user_id=ff9cc6bfcc944e9cab7f1fa78dfc53fe, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:26.162430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:26.173068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1172/2341] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:26 2022] PUT /identity/v3/projects/5fc3a020c4b84735bc00889438056825/users/ff9cc6bfcc944e9cab7f1fa78dfc53fe/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:26.184355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb612c-a685-4eb5-b7f6-a2f1747e435e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:26.184643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb612c-a685-4eb5-b7f6-a2f1747e435e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:26.184918 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb612c-a685-4eb5-b7f6-a2f1747e435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:26.212793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-90cb612c-a685-4eb5-b7f6-a2f1747e435e None None] MFA Rules not processed for user `ff9cc6bfcc944e9cab7f1fa78dfc53fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:26.214353 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-90cb612c-a685-4eb5-b7f6-a2f1747e435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:26.283090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1170/2342] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:26 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:26.294871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:26.296818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:26.359480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db7460-972f-488b-a5a7-f25ce68aa0e7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:26.363208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:26.363826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:26.364107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:26.364433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:26.373749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:26.375412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:26.385295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1173/2343] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:26 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:26.537500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb612c-a685-4eb5-b7f6-a2f1747e435e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:26.541942 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:26.573955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:26.575821 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:26.616927 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb612c-a685-4eb5-b7f6-a2f1747e435e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:26.622210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:26.623065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:26.623447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:26.623781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] PATH_INFO: `/v3/users/b0f69220c7a9431ba215b071f5d8c58a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:26.624908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f69220c7a9431ba215b071f5d8c58a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:26.628634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:26.645267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fc16-a3b2-45d3-806c-498a405d37a5 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:26.649186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c6a56-b685-438d-a15c-82b738cf0147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:26.649808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c6a56-b685-438d-a15c-82b738cf0147 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:26.650090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c6a56-b685-438d-a15c-82b738cf0147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:26.650365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c6a56-b685-438d-a15c-82b738cf0147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:26.652252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7e4c6a56-b685-438d-a15c-82b738cf0147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:26.666165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c6a56-b685-438d-a15c-82b738cf0147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:26.670477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c6a56-b685-438d-a15c-82b738cf0147 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:26.678586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1174/2344] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:26.832704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f69220c7a9431ba215b071f5d8c58a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:26.925554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f69220c7a9431ba215b071f5d8c58a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:26.926193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f69220c7a9431ba215b071f5d8c58a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:26.940746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f69220c7a9431ba215b071f5d8c58a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:26.941519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f69220c7a9431ba215b071f5d8c58a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:26.954312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1171/2345] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:26 2022] DELETE /identity/v3/users/b0f69220c7a9431ba215b071f5d8c58a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:26.958872 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f660-e68c-4e98-a3bd-aace2b66f886 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:26.960454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f660-e68c-4e98-a3bd-aace2b66f886 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:26.960454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f660-e68c-4e98-a3bd-aace2b66f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:26.978670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1f87f660-e68c-4e98-a3bd-aace2b66f886 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:26.979945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f87f660-e68c-4e98-a3bd-aace2b66f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:27.033760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:27.042128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1175/2346] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:27.070782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:27.072497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:27.151034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b0a3e-b5d6-4d8f-8423-69803dd3b48f admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:27.155004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96961ad8-aeb0-404d-890a-8be924d972db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:27.155710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96961ad8-aeb0-404d-890a-8be924d972db service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:27.156051 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96961ad8-aeb0-404d-890a-8be924d972db service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:27.156419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96961ad8-aeb0-404d-890a-8be924d972db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:27.167032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96961ad8-aeb0-404d-890a-8be924d972db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:27.169288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96961ad8-aeb0-404d-890a-8be924d972db service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:27.180592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1172/2347] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:27.794284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87f660-e68c-4e98-a3bd-aace2b66f886 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:27.796053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f87f660-e68c-4e98-a3bd-aace2b66f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:27.812250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87f660-e68c-4e98-a3bd-aace2b66f886 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:27.818013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:27.818776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:27.819129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:27.819635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] PATH_INFO: `/v3/projects/d980cbed94c447e2abd8ccd20bc1ecd5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:27.821146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d980cbed94c447e2abd8ccd20bc1ecd5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:27.823563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:27.968874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd980cbed94c447e2abd8ccd20bc1ecd5', 'request_id': 'req-a852e243-cdd0-452b-a3fb-3f08aabf5736'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:27.990251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd980cbed94c447e2abd8ccd20bc1ecd5', 'request_id': 'req-a852e243-cdd0-452b-a3fb-3f08aabf5736'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:27.998096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd980cbed94c447e2abd8ccd20bc1ecd5', 'request_id': 'req-a852e243-cdd0-452b-a3fb-3f08aabf5736'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:28.111662 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] The token cache is being invalidate because project d980cbed94c447e2abd8ccd20bc1ecd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:28.111965 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:28.112719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:28.114476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1176/2348] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:27 2022] DELETE /identity/v3/projects/d980cbed94c447e2abd8ccd20bc1ecd5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:28.118601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96961ad8-aeb0-404d-890a-8be924d972db service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:28.129330 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96961ad8-aeb0-404d-890a-8be924d972db service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:28.150827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:28.189710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:28.190456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:28.190744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:28.191022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] PATH_INFO: `/v3/users/ff9cc6bfcc944e9cab7f1fa78dfc53fe` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:28.192905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9cc6bfcc944e9cab7f1fa78dfc53fe)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:28.194340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:28.376860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9cc6bfcc944e9cab7f1fa78dfc53fe'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:28.443426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9cc6bfcc944e9cab7f1fa78dfc53fe'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:28.444144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9cc6bfcc944e9cab7f1fa78dfc53fe'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:28.458701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9cc6bfcc944e9cab7f1fa78dfc53fe'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:28.459538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-29ecf3a4-acda-47ce-893c-26ef22211cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9cc6bfcc944e9cab7f1fa78dfc53fe'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:28.482246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1173/2349] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:28 2022] DELETE /identity/v3/users/ff9cc6bfcc944e9cab7f1fa78dfc53fe => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:29.075925 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:29.078043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:29.092341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852e243-cdd0-452b-a3fb-3f08aabf5736 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:29.167331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:29.168162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:29.168574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:29.168957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] PATH_INFO: `/v3/projects/5fc3a020c4b84735bc00889438056825` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:29.170448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc3a020c4b84735bc00889438056825)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:29.172651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:29.299020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc3a020c4b84735bc00889438056825', 'request_id': 'req-4324759f-3011-4343-9d9c-3872f991537f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:29.307035 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc3a020c4b84735bc00889438056825', 'request_id': 'req-4324759f-3011-4343-9d9c-3872f991537f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:29.318543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc3a020c4b84735bc00889438056825', 'request_id': 'req-4324759f-3011-4343-9d9c-3872f991537f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:29.397194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] The token cache is being invalidate because project 5fc3a020c4b84735bc00889438056825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:29.397486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:29.398099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4324759f-3011-4343-9d9c-3872f991537f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:29.399708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1177/2350] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:29 2022] DELETE /identity/v3/projects/5fc3a020c4b84735bc00889438056825 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:29.404868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab5ee-a57a-4413-9476-06569ecdff55 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:29.405377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab5ee-a57a-4413-9476-06569ecdff55 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:29.405538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab5ee-a57a-4413-9476-06569ecdff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:29.425759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-179ab5ee-a57a-4413-9476-06569ecdff55 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:29.427058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-179ab5ee-a57a-4413-9476-06569ecdff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:29.497535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1174/2351] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:29.505444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec454a3-f6c9-4d85-a2df-288e782b3a7a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:29.509643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec454a3-f6c9-4d85-a2df-288e782b3a7a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:29.509643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec454a3-f6c9-4d85-a2df-288e782b3a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:29.526399 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4ec454a3-f6c9-4d85-a2df-288e782b3a7a None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:29.527682 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4ec454a3-f6c9-4d85-a2df-288e782b3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:29.536631 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1178/2352] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:29.540858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab5ee-a57a-4413-9476-06569ecdff55 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:29.551295 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ab5ee-a57a-4413-9476-06569ecdff55 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:29.556205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:29.556839 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:29.557118 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:29.557409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:29.558173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:29.558498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:29.560082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:29.575946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1175/2353] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:29:29.577402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec454a3-f6c9-4d85-a2df-288e782b3a7a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:29.586918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec454a3-f6c9-4d85-a2df-288e782b3a7a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:29.591677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150f22f-63a5-4b94-a935-a105ee6f37c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:29.592282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150f22f-63a5-4b94-a935-a105ee6f37c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:29.592637 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150f22f-63a5-4b94-a935-a105ee6f37c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:29.592914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150f22f-63a5-4b94-a935-a105ee6f37c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:29.593572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150f22f-63a5-4b94-a935-a105ee6f37c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:29.596264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150f22f-63a5-4b94-a935-a105ee6f37c1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:29.600900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:29.734184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1179/2354] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:29 2022] POST /identity/v3/projects => generated 403 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:29.738217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:29.749134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89afd01-b1d9-4ab0-8a38-5f78ec462d24 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:29.784130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:29.820414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2353521-2213-4b52-b79b-ae998b900567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:29.821100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2353521-2213-4b52-b79b-ae998b900567 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:29.821781 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2353521-2213-4b52-b79b-ae998b900567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:29.822125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2353521-2213-4b52-b79b-ae998b900567 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:29.824200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2353521-2213-4b52-b79b-ae998b900567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:29.825796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2353521-2213-4b52-b79b-ae998b900567 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:29.907005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1176/2355] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:29 2022] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:29.911495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150f22f-63a5-4b94-a935-a105ee6f37c1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:29.925246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150f22f-63a5-4b94-a935-a105ee6f37c1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:29.932987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cfe6e-b89d-49bf-9873-7d2f3023043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:29.932987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cfe6e-b89d-49bf-9873-7d2f3023043b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:29.932987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cfe6e-b89d-49bf-9873-7d2f3023043b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:29.932987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cfe6e-b89d-49bf-9873-7d2f3023043b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:29.933374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cfe6e-b89d-49bf-9873-7d2f3023043b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:29.934923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cfe6e-b89d-49bf-9873-7d2f3023043b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:29.946858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1180/2356] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:29.950677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2353521-2213-4b52-b79b-ae998b900567 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:29.963977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2353521-2213-4b52-b79b-ae998b900567 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:29.969442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561c181-15d2-47af-bf95-68e048fb403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:29.970238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c181-15d2-47af-bf95-68e048fb403e admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:29.970641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c181-15d2-47af-bf95-68e048fb403e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:29.971008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561c181-15d2-47af-bf95-68e048fb403e admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:29.971661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561c181-15d2-47af-bf95-68e048fb403e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:29.973318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561c181-15d2-47af-bf95-68e048fb403e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:29.989660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1177/2357] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:29.990400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cfe6e-b89d-49bf-9873-7d2f3023043b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:29.999780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cfe6e-b89d-49bf-9873-7d2f3023043b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:30.005518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:30.006188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:30.006473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:30.006753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] PATH_INFO: `/v3/projects/174e25f3acf246afa68347db50dc1119/users/ba4794541d3745b988279b7792e9a4e9/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:30.024706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174e25f3acf246afa68347db50dc1119, user_id=ba4794541d3745b988279b7792e9a4e9, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:30.027359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:30.131225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1181/2358] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:29 2022] PUT /identity/v3/projects/174e25f3acf246afa68347db50dc1119/users/ba4794541d3745b988279b7792e9a4e9/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:30.136473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef872a-df8f-47f1-99d8-51071919a20f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:30.136762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef872a-df8f-47f1-99d8-51071919a20f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:30.137058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef872a-df8f-47f1-99d8-51071919a20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:30.175235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-42ef872a-df8f-47f1-99d8-51071919a20f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:30.176908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-42ef872a-df8f-47f1-99d8-51071919a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:30.268016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1178/2359] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:30.273669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:30.275494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:30.368203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b27a6-ab74-444f-8cab-0e1aa00b9d43 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:30.372118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:30.372779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:30.373063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:30.373339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:30.393461 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:30.397211 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:30.408286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1182/2360] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:30.733402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef872a-df8f-47f1-99d8-51071919a20f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:30.735381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-42ef872a-df8f-47f1-99d8-51071919a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:30.832674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef872a-df8f-47f1-99d8-51071919a20f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:30.837958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:30.838605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:30.838885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:30.839184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:30.840913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:30.853028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:30.855039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:30.865768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1179/2361] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:30.896042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:30.897370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:30.911177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88bdd4-d832-46e9-ad2b-1b476e516fc7 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:30.916757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:30.919593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:30.919593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:30.919593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] PATH_INFO: `/v3/users/9713207bf34847ae8faf498fc96061e2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:30.920875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9713207bf34847ae8faf498fc96061e2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:30.923660 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:31.149517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9713207bf34847ae8faf498fc96061e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.150187 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9713207bf34847ae8faf498fc96061e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.232592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9713207bf34847ae8faf498fc96061e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.242057 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9713207bf34847ae8faf498fc96061e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.258330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9713207bf34847ae8faf498fc96061e2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.271924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1183/2362] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:30 2022] DELETE /identity/v3/users/9713207bf34847ae8faf498fc96061e2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:31.360690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:31.370254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dc365-b65e-41ec-ba80-e9db4ef486f1 service placement] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:31.410139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:31.420675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449b43-9fa3-4fe4-b107-6193c2581742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:31.421280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449b43-9fa3-4fe4-b107-6193c2581742 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:31.421559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449b43-9fa3-4fe4-b107-6193c2581742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:31.421832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449b43-9fa3-4fe4-b107-6193c2581742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:31.423605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f6449b43-9fa3-4fe4-b107-6193c2581742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:31.498743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449b43-9fa3-4fe4-b107-6193c2581742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:31.500270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449b43-9fa3-4fe4-b107-6193c2581742 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:31.510399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1180/2363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:31.557266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:31.557266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:31.571669 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970625f0-6254-4db4-862b-63895ac9c929 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:31.577499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:31.578470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:31.584742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:31.584742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] PATH_INFO: `/v3/projects/b6eb8e1e92854f0db8837459a7058eeb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:31.584742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6eb8e1e92854f0db8837459a7058eeb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:31.584742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:31.607298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:31.707983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6eb8e1e92854f0db8837459a7058eeb', 'request_id': 'req-cef4936e-88be-4d02-aa57-9b1c533e9758'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.714160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6eb8e1e92854f0db8837459a7058eeb', 'request_id': 'req-cef4936e-88be-4d02-aa57-9b1c533e9758'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.720726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6eb8e1e92854f0db8837459a7058eeb', 'request_id': 'req-cef4936e-88be-4d02-aa57-9b1c533e9758'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.792121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] The token cache is being invalidate because project b6eb8e1e92854f0db8837459a7058eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:31.792440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.793062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cef4936e-88be-4d02-aa57-9b1c533e9758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:31.794750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1184/2364] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:31 2022] DELETE /identity/v3/projects/b6eb8e1e92854f0db8837459a7058eeb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:31.799868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831efb37-41d0-42d6-8444-b79d24c2614d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:31.800945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831efb37-41d0-42d6-8444-b79d24c2614d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:31.801206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831efb37-41d0-42d6-8444-b79d24c2614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:31.837508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-831efb37-41d0-42d6-8444-b79d24c2614d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:31.838757 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-831efb37-41d0-42d6-8444-b79d24c2614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:31.907300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1181/2365] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:31.915703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40dcd-2b5f-408e-b24d-f28b7efa4ff0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:31.915991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40dcd-2b5f-408e-b24d-f28b7efa4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:31.916272 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40dcd-2b5f-408e-b24d-f28b7efa4ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:31.934537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06219811-79dc-46ac-a2c2-dde26bb714f6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:31.934824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06219811-79dc-46ac-a2c2-dde26bb714f6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:31.935303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06219811-79dc-46ac-a2c2-dde26bb714f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:31.946984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8ec40dcd-2b5f-408e-b24d-f28b7efa4ff0 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:31.948205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8ec40dcd-2b5f-408e-b24d-f28b7efa4ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:31.968469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1185/2366] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:31.969392 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40dcd-2b5f-408e-b24d-f28b7efa4ff0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:31.972515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-06219811-79dc-46ac-a2c2-dde26bb714f6 None None] MFA Rules not processed for user `ba4794541d3745b988279b7792e9a4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:31.974165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-06219811-79dc-46ac-a2c2-dde26bb714f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:31.985062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40dcd-2b5f-408e-b24d-f28b7efa4ff0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:31.992670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:31.994176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:31.994750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:31.995178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:31.996604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:31.997079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:31.998837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.017012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1186/2367] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:29:32.018237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.030335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd068bf4-aaf0-4d37-be38-6b5b596fc846 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.037707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2374fdd-051d-42cc-89cd-3d2c6dabe25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.038494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2374fdd-051d-42cc-89cd-3d2c6dabe25d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.038839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2374fdd-051d-42cc-89cd-3d2c6dabe25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.039423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2374fdd-051d-42cc-89cd-3d2c6dabe25d admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.040486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2374fdd-051d-42cc-89cd-3d2c6dabe25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.042997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2374fdd-051d-42cc-89cd-3d2c6dabe25d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.066525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1182/2368] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:32.070743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06219811-79dc-46ac-a2c2-dde26bb714f6 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.072049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-06219811-79dc-46ac-a2c2-dde26bb714f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:32.085969 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06219811-79dc-46ac-a2c2-dde26bb714f6 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.090450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f333da-9a3c-4eea-8efa-e318f86fc1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.091327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f333da-9a3c-4eea-8efa-e318f86fc1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.091665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f333da-9a3c-4eea-8efa-e318f86fc1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.092025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f333da-9a3c-4eea-8efa-e318f86fc1a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.092707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f333da-9a3c-4eea-8efa-e318f86fc1a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.094594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f333da-9a3c-4eea-8efa-e318f86fc1a9 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.161212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1187/2369] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:32 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:32.165223 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2374fdd-051d-42cc-89cd-3d2c6dabe25d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.193222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:32.201694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1183/2370] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:32 2022] POST /identity/v3/projects => generated 403 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:32.206040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f333da-9a3c-4eea-8efa-e318f86fc1a9 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.233913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2374fdd-051d-42cc-89cd-3d2c6dabe25d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.275258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f333da-9a3c-4eea-8efa-e318f86fc1a9 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.280841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884682b4-0ecc-4d55-8859-e28a79557b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.281641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884682b4-0ecc-4d55-8859-e28a79557b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.282123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884682b4-0ecc-4d55-8859-e28a79557b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.282432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884682b4-0ecc-4d55-8859-e28a79557b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.283880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884682b4-0ecc-4d55-8859-e28a79557b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.286044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884682b4-0ecc-4d55-8859-e28a79557b01 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.296089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e7a78-6bd5-47dc-afb5-92a552507fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.296769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e7a78-6bd5-47dc-afb5-92a552507fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.297044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e7a78-6bd5-47dc-afb5-92a552507fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.297323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e7a78-6bd5-47dc-afb5-92a552507fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.297946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e7a78-6bd5-47dc-afb5-92a552507fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.299899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e7a78-6bd5-47dc-afb5-92a552507fe2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.369923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1184/2371] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:32 2022] POST /identity/v3/users => generated 308 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:32.374159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884682b4-0ecc-4d55-8859-e28a79557b01 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.381063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1188/2372] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:32 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:32.384840 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e7a78-6bd5-47dc-afb5-92a552507fe2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.385450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884682b4-0ecc-4d55-8859-e28a79557b01 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.390690 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:32.391025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2d3e6-c035-4705-a748-3e7336bbc61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.393127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d3e6-c035-4705-a748-3e7336bbc61c admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.393678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d3e6-c035-4705-a748-3e7336bbc61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.394022 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2d3e6-c035-4705-a748-3e7336bbc61c admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.395274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d3e6-c035-4705-a748-3e7336bbc61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.396897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e7a78-6bd5-47dc-afb5-92a552507fe2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.397020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2d3e6-c035-4705-a748-3e7336bbc61c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.401846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a20a79-807f-4577-8db9-9ce5070e9a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.402572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a20a79-807f-4577-8db9-9ce5070e9a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.402856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a20a79-807f-4577-8db9-9ce5070e9a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.403135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a20a79-807f-4577-8db9-9ce5070e9a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.403783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a20a79-807f-4577-8db9-9ce5070e9a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.405584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a20a79-807f-4577-8db9-9ce5070e9a19 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.410528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1185/2373] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:32.414622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2d3e6-c035-4705-a748-3e7336bbc61c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.417457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1189/2374] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:32.422098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a20a79-807f-4577-8db9-9ce5070e9a19 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.424858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2d3e6-c035-4705-a748-3e7336bbc61c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.429907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d998a4-0503-4e48-8f9c-957eba6ed45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.430572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d998a4-0503-4e48-8f9c-957eba6ed45d admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.430847 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d998a4-0503-4e48-8f9c-957eba6ed45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.431124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d998a4-0503-4e48-8f9c-957eba6ed45d admin admin] PATH_INFO: `/v3/projects/81cfe430727747f38a59a54a1ee28893/users/40e9655e95014bce8624f24f34b36a16/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.432761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a20a79-807f-4577-8db9-9ce5070e9a19 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.439350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be0e5e-ea9f-4dbf-910b-10f39b4f571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.440202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0e5e-ea9f-4dbf-910b-10f39b4f571e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.451238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0e5e-ea9f-4dbf-910b-10f39b4f571e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.451238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0e5e-ea9f-4dbf-910b-10f39b4f571e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.451238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be0e5e-ea9f-4dbf-910b-10f39b4f571e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.451238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be0e5e-ea9f-4dbf-910b-10f39b4f571e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.451659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d998a4-0503-4e48-8f9c-957eba6ed45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cfe430727747f38a59a54a1ee28893, user_id=40e9655e95014bce8624f24f34b36a16, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.451659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d998a4-0503-4e48-8f9c-957eba6ed45d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.460341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1190/2375] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:32.462421 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be0e5e-ea9f-4dbf-910b-10f39b4f571e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.472595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be0e5e-ea9f-4dbf-910b-10f39b4f571e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.477405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c42a-8fd5-46ad-a231-32ebcaac48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.478031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c42a-8fd5-46ad-a231-32ebcaac48a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.478309 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c42a-8fd5-46ad-a231-32ebcaac48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.478579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c42a-8fd5-46ad-a231-32ebcaac48a8 admin admin] PATH_INFO: `/v3/projects/abd18506f77f49fcad6e73a47298841e/users/1ea229fce76f4a1db11ec1ddcd50564f/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.493324 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169c42a-8fd5-46ad-a231-32ebcaac48a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd18506f77f49fcad6e73a47298841e, user_id=1ea229fce76f4a1db11ec1ddcd50564f, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.495952 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169c42a-8fd5-46ad-a231-32ebcaac48a8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.535079 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1186/2376] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:32 2022] PUT /identity/v3/projects/81cfe430727747f38a59a54a1ee28893/users/40e9655e95014bce8624f24f34b36a16/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:32.543321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d998a4-0503-4e48-8f9c-957eba6ed45d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.591105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1191/2377] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:32 2022] PUT /identity/v3/projects/abd18506f77f49fcad6e73a47298841e/users/1ea229fce76f4a1db11ec1ddcd50564f/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:32.603792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4830e3-9846-4a35-8e2c-215192a000b2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.604382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4830e3-9846-4a35-8e2c-215192a000b2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.604887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4830e3-9846-4a35-8e2c-215192a000b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.627436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d998a4-0503-4e48-8f9c-957eba6ed45d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.639163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2e4830e3-9846-4a35-8e2c-215192a000b2 None None] MFA Rules not processed for user `1ea229fce76f4a1db11ec1ddcd50564f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:32.640469 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2e4830e3-9846-4a35-8e2c-215192a000b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:32.717061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a404-298e-4d7c-946d-2b127e384b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.718396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a404-298e-4d7c-946d-2b127e384b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.718552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a404-298e-4d7c-946d-2b127e384b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.718784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a404-298e-4d7c-946d-2b127e384b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.719439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711a404-298e-4d7c-946d-2b127e384b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.721255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711a404-298e-4d7c-946d-2b127e384b94 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.722785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:32.731308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1192/2378] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:32.733853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1187/2379] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:32.745567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4830e3-9846-4a35-8e2c-215192a000b2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.746947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a404-298e-4d7c-946d-2b127e384b94 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.760164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a404-298e-4d7c-946d-2b127e384b94 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.766459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ff597-5362-438c-8814-2959d42c8004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.768533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ff597-5362-438c-8814-2959d42c8004 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.772265 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4830e3-9846-4a35-8e2c-215192a000b2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:32.772417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ff597-5362-438c-8814-2959d42c8004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.772417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ff597-5362-438c-8814-2959d42c8004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.772417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ff597-5362-438c-8814-2959d42c8004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.773261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ff597-5362-438c-8814-2959d42c8004 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.774658 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82c36e-1484-4b94-a3d7-e7bbfb2e5936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:32.775397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82c36e-1484-4b94-a3d7-e7bbfb2e5936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:32.775743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82c36e-1484-4b94-a3d7-e7bbfb2e5936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:32.776082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82c36e-1484-4b94-a3d7-e7bbfb2e5936 admin admin] PATH_INFO: `/v3/projects/81cfe430727747f38a59a54a1ee28893/users/40e9655e95014bce8624f24f34b36a16/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:32.778916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82c36e-1484-4b94-a3d7-e7bbfb2e5936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cfe430727747f38a59a54a1ee28893, user_id=40e9655e95014bce8624f24f34b36a16, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:32.783157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82c36e-1484-4b94-a3d7-e7bbfb2e5936 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:32.795167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1193/2380] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:32 2022] PUT /identity/v3/projects/81cfe430727747f38a59a54a1ee28893/users/40e9655e95014bce8624f24f34b36a16/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:32.898952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1188/2381] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:32 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:32.900757 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82c36e-1484-4b94-a3d7-e7bbfb2e5936 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:32.975036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82c36e-1484-4b94-a3d7-e7bbfb2e5936 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:33.018491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:33.039165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c721-d5ac-4254-bfa5-5b997d10f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:33.039900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c721-d5ac-4254-bfa5-5b997d10f147 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:33.040251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c721-d5ac-4254-bfa5-5b997d10f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:33.040564 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c721-d5ac-4254-bfa5-5b997d10f147 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:33.041218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c721-d5ac-4254-bfa5-5b997d10f147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:33.043122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c721-d5ac-4254-bfa5-5b997d10f147 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:33.154434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1194/2382] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:32 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:33.157604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ff597-5362-438c-8814-2959d42c8004 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:33.174500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ff597-5362-438c-8814-2959d42c8004 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:33.182124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508e772-f990-4757-b881-d2d85a7182f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:33.183688 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e772-f990-4757-b881-d2d85a7182f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:33.184216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e772-f990-4757-b881-d2d85a7182f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:33.184744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e772-f990-4757-b881-d2d85a7182f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:33.186229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508e772-f990-4757-b881-d2d85a7182f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:33.189920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508e772-f990-4757-b881-d2d85a7182f0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:33.207013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1189/2383] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:33.211236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c721-d5ac-4254-bfa5-5b997d10f147 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:33.222612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c721-d5ac-4254-bfa5-5b997d10f147 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:33.227475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b1511-3a86-4776-b05c-a84e92afe5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:33.228166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b1511-3a86-4776-b05c-a84e92afe5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:33.228487 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b1511-3a86-4776-b05c-a84e92afe5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:33.228768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b1511-3a86-4776-b05c-a84e92afe5b9 admin admin] PATH_INFO: `/v3/projects/a22025d352cc42deae8d2481e0017813/users/c2254487847949b7bdee6cfc3fe8c86a/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:33.245908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b1511-3a86-4776-b05c-a84e92afe5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22025d352cc42deae8d2481e0017813, user_id=c2254487847949b7bdee6cfc3fe8c86a, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:33.248749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b1511-3a86-4776-b05c-a84e92afe5b9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:33.368090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1195/2384] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:33 2022] PUT /identity/v3/projects/a22025d352cc42deae8d2481e0017813/users/c2254487847949b7bdee6cfc3fe8c86a/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:33.372828 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508e772-f990-4757-b881-d2d85a7182f0 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:33.384099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508e772-f990-4757-b881-d2d85a7182f0 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:33.452923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a9e24-7004-4b70-80ef-8491a8ede5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:33.453634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a9e24-7004-4b70-80ef-8491a8ede5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:33.454016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a9e24-7004-4b70-80ef-8491a8ede5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:33.455293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a9e24-7004-4b70-80ef-8491a8ede5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:33.458547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a9e24-7004-4b70-80ef-8491a8ede5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:33.458547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a9e24-7004-4b70-80ef-8491a8ede5e6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:33.474981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1190/2385] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:33.476459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b1511-3a86-4776-b05c-a84e92afe5b9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:33.489803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b1511-3a86-4776-b05c-a84e92afe5b9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:33.495441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:33.496121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:33.496477 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:33.496753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] PATH_INFO: `/v3/projects/a22025d352cc42deae8d2481e0017813/users/c2254487847949b7bdee6cfc3fe8c86a/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:33.499273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22025d352cc42deae8d2481e0017813, user_id=c2254487847949b7bdee6cfc3fe8c86a, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:33.503045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:33.518356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1196/2386] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:33 2022] PUT /identity/v3/projects/a22025d352cc42deae8d2481e0017813/users/c2254487847949b7bdee6cfc3fe8c86a/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:33.528798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73c71c-ccbd-4ac4-b4fb-7960f9d19707 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:33.529135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73c71c-ccbd-4ac4-b4fb-7960f9d19707 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:33.529421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73c71c-ccbd-4ac4-b4fb-7960f9d19707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:33.563246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-3c73c71c-ccbd-4ac4-b4fb-7960f9d19707 None None] MFA Rules not processed for user `c2254487847949b7bdee6cfc3fe8c86a`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:33.565274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3c73c71c-ccbd-4ac4-b4fb-7960f9d19707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:33.646696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1191/2387] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:33.659914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:33.662191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:33.744575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1ceaa-9ff5-402b-88d3-95d08d3ebb69 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:33.747889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ce3e0-b834-4384-8e8f-a04edc2305e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:33.748576 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ce3e0-b834-4384-8e8f-a04edc2305e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:33.748854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ce3e0-b834-4384-8e8f-a04edc2305e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:33.749127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ce3e0-b834-4384-8e8f-a04edc2305e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:33.758940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ce3e0-b834-4384-8e8f-a04edc2305e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:33.761215 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ce3e0-b834-4384-8e8f-a04edc2305e9 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:33.772609 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1197/2388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:33.840601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73c71c-ccbd-4ac4-b4fb-7960f9d19707 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:33.888112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:33.905831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73c71c-ccbd-4ac4-b4fb-7960f9d19707 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:33.910473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:33.911045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:33.911323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:33.911594 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] PATH_INFO: `/v3/users/1ea229fce76f4a1db11ec1ddcd50564f` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:33.912741 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea229fce76f4a1db11ec1ddcd50564f)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:33.914650 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:34.130684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea229fce76f4a1db11ec1ddcd50564f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:34.215154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea229fce76f4a1db11ec1ddcd50564f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:34.215853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea229fce76f4a1db11ec1ddcd50564f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:34.230129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea229fce76f4a1db11ec1ddcd50564f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:34.230777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea229fce76f4a1db11ec1ddcd50564f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:34.243896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1192/2389] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:33 2022] DELETE /identity/v3/users/1ea229fce76f4a1db11ec1ddcd50564f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:34.248526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2823c2-fa59-477a-8044-9ed74a265f41 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:34.249098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2823c2-fa59-477a-8044-9ed74a265f41 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:34.249098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2823c2-fa59-477a-8044-9ed74a265f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:34.269180 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0d2823c2-fa59-477a-8044-9ed74a265f41 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:34.270857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0d2823c2-fa59-477a-8044-9ed74a265f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:34.339860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1198/2390] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:34.346905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:34.348999 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:34.421593 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e94889-74df-4c73-b6e0-598cc80d6245 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:34.426180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:34.426960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:34.427337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:34.427862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:34.444373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:34.447736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:34.461279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1193/2391] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:34.754485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fde4b-6d2f-4bd2-bcf5-c37370021444 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:34.754906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fde4b-6d2f-4bd2-bcf5-c37370021444 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:34.755279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fde4b-6d2f-4bd2-bcf5-c37370021444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:34.796526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4a4fde4b-6d2f-4bd2-bcf5-c37370021444 None None] MFA Rules not processed for user `40e9655e95014bce8624f24f34b36a16`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:34.799572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4a4fde4b-6d2f-4bd2-bcf5-c37370021444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:34.843294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:34.900224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1199/2392] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:35.041793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:35.041793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:35.061956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4bd7d-8be1-467e-9c64-9ff2f8d5d165 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:35.068352 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:35.069447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:35.069983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:35.070306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] PATH_INFO: `/v3/projects/abd18506f77f49fcad6e73a47298841e` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:35.071764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd18506f77f49fcad6e73a47298841e)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:35.074056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:35.222550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd18506f77f49fcad6e73a47298841e', 'request_id': 'req-9d6cb358-138f-4923-b612-4529fcb98b49'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.230457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd18506f77f49fcad6e73a47298841e', 'request_id': 'req-9d6cb358-138f-4923-b612-4529fcb98b49'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.236970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:35.239045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd18506f77f49fcad6e73a47298841e', 'request_id': 'req-9d6cb358-138f-4923-b612-4529fcb98b49'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.347784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] The token cache is being invalidate because project abd18506f77f49fcad6e73a47298841e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:35.353205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.354121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.356238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1194/2393] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:35 2022] DELETE /identity/v3/projects/abd18506f77f49fcad6e73a47298841e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:35.360133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fde4b-6d2f-4bd2-bcf5-c37370021444 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:35.381725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fde4b-6d2f-4bd2-bcf5-c37370021444 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:35.449697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:35.450847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:35.451128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:35.451402 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] PATH_INFO: `/v3/users/c2254487847949b7bdee6cfc3fe8c86a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:35.452796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2254487847949b7bdee6cfc3fe8c86a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:35.455287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:35.608103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2254487847949b7bdee6cfc3fe8c86a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.608918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2254487847949b7bdee6cfc3fe8c86a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.661144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2254487847949b7bdee6cfc3fe8c86a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.670146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2254487847949b7bdee6cfc3fe8c86a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.684806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2254487847949b7bdee6cfc3fe8c86a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:35.697188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1200/2394] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:35 2022] DELETE /identity/v3/users/c2254487847949b7bdee6cfc3fe8c86a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:36.150113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:36.151763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:36.169984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cb358-138f-4923-b612-4529fcb98b49 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:36.228846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:36.235007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:36.235007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:36.235007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] PATH_INFO: `/v3/users/732e7072abde49de887256b43707c0b9` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:36.235240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:36.235323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=732e7072abde49de887256b43707c0b9)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:36.236735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:36.237743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:36.258297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7529b7-42e7-4bde-acf0-c89d23b346bb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:36.264042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:36.264885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:36.268652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:36.268652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] PATH_INFO: `/v3/projects/a22025d352cc42deae8d2481e0017813` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:36.268652 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22025d352cc42deae8d2481e0017813)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:36.270341 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:36.445563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:36.456802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732e7072abde49de887256b43707c0b9'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.457192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22025d352cc42deae8d2481e0017813', 'request_id': 'req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.463429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22025d352cc42deae8d2481e0017813', 'request_id': 'req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.469814 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22025d352cc42deae8d2481e0017813', 'request_id': 'req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.524414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732e7072abde49de887256b43707c0b9'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.525027 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732e7072abde49de887256b43707c0b9'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.543517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732e7072abde49de887256b43707c0b9'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.544252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-fd48be8f-a991-432f-a425-b44841dbff8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732e7072abde49de887256b43707c0b9'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.557203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1195/2395] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:36 2022] DELETE /identity/v3/users/732e7072abde49de887256b43707c0b9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:36.607833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] The token cache is being invalidate because project a22025d352cc42deae8d2481e0017813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:36.608161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.608828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:36.610352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1201/2396] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:36 2022] DELETE /identity/v3/projects/a22025d352cc42deae8d2481e0017813 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:36.618699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340909-1ea2-4d38-b3c6-fc2ee20fecd5 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:36.618983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340909-1ea2-4d38-b3c6-fc2ee20fecd5 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:36.619256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340909-1ea2-4d38-b3c6-fc2ee20fecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:36.639639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-59340909-1ea2-4d38-b3c6-fc2ee20fecd5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:36.650461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-59340909-1ea2-4d38-b3c6-fc2ee20fecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:36.652168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:36.654654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:36.725774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1196/2397] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:36.733482 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574ec88-6c28-42a9-9dcd-7c24f231d243 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:36.733918 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574ec88-6c28-42a9-9dcd-7c24f231d243 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:36.734123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574ec88-6c28-42a9-9dcd-7c24f231d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:36.748031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abf5a8-3f7a-4bf3-b42e-52ab4c585cf2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:36.753906 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:36.757696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:36.757696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:36.757696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] PATH_INFO: `/v3/users/ba4794541d3745b988279b7792e9a4e9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:36.757696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4794541d3745b988279b7792e9a4e9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:36.758041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-4574ec88-6c28-42a9-9dcd-7c24f231d243 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:36.758041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4574ec88-6c28-42a9-9dcd-7c24f231d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:36.758737 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:36.774851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1197/2398] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:36.778975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574ec88-6c28-42a9-9dcd-7c24f231d243 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:36.786279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:36.790237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574ec88-6c28-42a9-9dcd-7c24f231d243 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:36.795077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:36.795683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:36.795961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:36.796222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:36.796954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:36.797257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:36.798900 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:36.812708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1198/2399] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:29:36.818676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:36.830743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2f826-a15e-40a3-b2ef-38a2974fffad admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:36.835586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:36.836182 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:36.836486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:36.836757 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:36.837380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:36.839273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:36.952997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1199/2400] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:36 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:36.953888 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:36.956337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.031456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d30e31-9cc3-4ccb-8a25-9f509a5cb567 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.036060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.036719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.036995 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.037262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] PATH_INFO: `/v3/projects/dc16f7eefdde47edafa81f2390554940` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.038406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc16f7eefdde47edafa81f2390554940)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.040288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.086515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4794541d3745b988279b7792e9a4e9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.087270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4794541d3745b988279b7792e9a4e9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.163409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4794541d3745b988279b7792e9a4e9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.169810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc16f7eefdde47edafa81f2390554940', 'request_id': 'req-4344538c-221a-4b5e-9382-4fe3239949f6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.170704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4794541d3745b988279b7792e9a4e9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.176163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc16f7eefdde47edafa81f2390554940', 'request_id': 'req-4344538c-221a-4b5e-9382-4fe3239949f6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.181754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc16f7eefdde47edafa81f2390554940', 'request_id': 'req-4344538c-221a-4b5e-9382-4fe3239949f6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.183855 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4794541d3745b988279b7792e9a4e9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.190793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1202/2401] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:36 2022] DELETE /identity/v3/users/ba4794541d3745b988279b7792e9a4e9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:37.194079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.194079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.240767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:37.256109 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] The token cache is being invalidate because project dc16f7eefdde47edafa81f2390554940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:37.256534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.257526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4344538c-221a-4b5e-9382-4fe3239949f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.262369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1200/2402] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:36 2022] DELETE /identity/v3/projects/dc16f7eefdde47edafa81f2390554940 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:37.264334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e911e38-d69d-42df-9f2d-18e8d255e19c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.266076 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d4c41-b8b9-4a32-b904-6638f3a69f97 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.266524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d4c41-b8b9-4a32-b904-6638f3a69f97 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.267368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d4c41-b8b9-4a32-b904-6638f3a69f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.270346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.271156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.271282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.271519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.272131 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.274103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.291774 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-968d4c41-b8b9-4a32-b904-6638f3a69f97 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:37.292744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-968d4c41-b8b9-4a32-b904-6638f3a69f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.302480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1201/2403] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:37.309822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc195-1984-4e54-90bf-9c3e9ba49ec9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.314294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc195-1984-4e54-90bf-9c3e9ba49ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.314294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc195-1984-4e54-90bf-9c3e9ba49ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.331367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a5ffc195-1984-4e54-90bf-9c3e9ba49ec9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:37.332634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a5ffc195-1984-4e54-90bf-9c3e9ba49ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.340430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1202/2404] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:37.344471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc195-1984-4e54-90bf-9c3e9ba49ec9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.353961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc195-1984-4e54-90bf-9c3e9ba49ec9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.358494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.359081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.359357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.359626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.360262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:37.360622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.362208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.373983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1203/2405] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:29:37.378178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.383265 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1203/2406] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:37 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:37.387306 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.387858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46639fda-9ed9-4c81-bb64-f07cb60e301b admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.389150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.393633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.394218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.394522 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.394791 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.395747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.397664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.402507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93095-f5fd-424b-b5fd-cb5bfc34548a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.407193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64693983-c2ce-4668-808c-3e487a34758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.408513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64693983-c2ce-4668-808c-3e487a34758d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.408798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64693983-c2ce-4668-808c-3e487a34758d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.409075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64693983-c2ce-4668-808c-3e487a34758d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.409728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64693983-c2ce-4668-808c-3e487a34758d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.411319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64693983-c2ce-4668-808c-3e487a34758d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.421383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1204/2407] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:37.425264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64693983-c2ce-4668-808c-3e487a34758d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.434496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64693983-c2ce-4668-808c-3e487a34758d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.438998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586f658-85f0-45c0-80fb-27a0b7dd8485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.439567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586f658-85f0-45c0-80fb-27a0b7dd8485 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.439847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586f658-85f0-45c0-80fb-27a0b7dd8485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.440119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586f658-85f0-45c0-80fb-27a0b7dd8485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.440778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586f658-85f0-45c0-80fb-27a0b7dd8485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.442357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586f658-85f0-45c0-80fb-27a0b7dd8485 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.452717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1205/2408] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:37.457021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586f658-85f0-45c0-80fb-27a0b7dd8485 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.466578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586f658-85f0-45c0-80fb-27a0b7dd8485 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.472023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0300690-4132-4843-bcc7-1191683320e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.472752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0300690-4132-4843-bcc7-1191683320e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.473033 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0300690-4132-4843-bcc7-1191683320e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.473308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0300690-4132-4843-bcc7-1191683320e5 admin admin] PATH_INFO: `/v3/projects/730bafa411514929ac48c91d0d028569/users/bb44156285df4e2b80dc732531d3f459/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.493434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0300690-4132-4843-bcc7-1191683320e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=730bafa411514929ac48c91d0d028569, user_id=bb44156285df4e2b80dc732531d3f459, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.495590 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1204/2409] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:37 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:37.496225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0300690-4132-4843-bcc7-1191683320e5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.503404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.505143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.515300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:37.567731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f795e-d521-45a0-aaf3-c4cdde578807 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.572379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.573006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.573285 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.573557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] PATH_INFO: `/v3/projects/174e25f3acf246afa68347db50dc1119` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.574715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=174e25f3acf246afa68347db50dc1119)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.576689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.627708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1206/2410] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:37 2022] PUT /identity/v3/projects/730bafa411514929ac48c91d0d028569/users/bb44156285df4e2b80dc732531d3f459/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:37.628569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0300690-4132-4843-bcc7-1191683320e5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.690883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0300690-4132-4843-bcc7-1191683320e5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.696373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b737794-ae2c-46ea-a94a-87470caadf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.696981 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737794-ae2c-46ea-a94a-87470caadf96 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.697258 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737794-ae2c-46ea-a94a-87470caadf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.697532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737794-ae2c-46ea-a94a-87470caadf96 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.698172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b737794-ae2c-46ea-a94a-87470caadf96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.700079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b737794-ae2c-46ea-a94a-87470caadf96 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.713638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174e25f3acf246afa68347db50dc1119', 'request_id': 'req-73a0dd05-8cdd-4f25-ab16-75c935c26cca'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.719626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174e25f3acf246afa68347db50dc1119', 'request_id': 'req-73a0dd05-8cdd-4f25-ab16-75c935c26cca'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.725617 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174e25f3acf246afa68347db50dc1119', 'request_id': 'req-73a0dd05-8cdd-4f25-ab16-75c935c26cca'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.850529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] The token cache is being invalidate because project 174e25f3acf246afa68347db50dc1119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:37.850817 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.854134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1207/2411] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:37 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:37.854134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310320c-aacd-406d-85d1-20af3c4f1d5d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.854134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310320c-aacd-406d-85d1-20af3c4f1d5d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.854134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310320c-aacd-406d-85d1-20af3c4f1d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.854925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:37.856778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1205/2412] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:37 2022] DELETE /identity/v3/projects/174e25f3acf246afa68347db50dc1119 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:37.857525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.858798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.882494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f310320c-aacd-406d-85d1-20af3c4f1d5d None None] MFA Rules not processed for user `bb44156285df4e2b80dc732531d3f459`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:37.883692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f310320c-aacd-406d-85d1-20af3c4f1d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.923984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0dd05-8cdd-4f25-ab16-75c935c26cca admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.929716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.931351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.931634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.931911 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.932579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.934216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.944613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1206/2413] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:37.945498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.947064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:37.952871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1208/2414] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:37.953706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310320c-aacd-406d-85d1-20af3c4f1d5d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.960294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:37.961773 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d608-f08b-4e0f-89c7-7e314a7b059a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.964589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310320c-aacd-406d-85d1-20af3c4f1d5d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:37.966415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.967035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.967316 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.967709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] PATH_INFO: `/v3/users/40e9655e95014bce8624f24f34b36a16` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.968856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e9655e95014bce8624f24f34b36a16)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.969205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:37.970352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:37.975044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:37.975044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:37.975245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.975347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:37.975347 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:37.983486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1209/2415] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:37.984353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:37.987666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.006012 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b536-25d3-437b-baf9-19bbdc87cd7a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.011336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6df34-1400-4c23-bcf3-6869ad461d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.011943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6df34-1400-4c23-bcf3-6869ad461d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.012435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6df34-1400-4c23-bcf3-6869ad461d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.012713 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6df34-1400-4c23-bcf3-6869ad461d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.013407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6df34-1400-4c23-bcf3-6869ad461d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.015320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6df34-1400-4c23-bcf3-6869ad461d5e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.085382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1210/2416] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:37 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:38.086110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6df34-1400-4c23-bcf3-6869ad461d5e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.107007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:38.120440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e9655e95014bce8624f24f34b36a16'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.148984 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6df34-1400-4c23-bcf3-6869ad461d5e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.153853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ded8cd-cc63-484a-826a-a4837de364ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.154538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded8cd-cc63-484a-826a-a4837de364ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.154819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded8cd-cc63-484a-826a-a4837de364ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.155093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ded8cd-cc63-484a-826a-a4837de364ed admin admin] PATH_INFO: `/v3/projects/22061a6dd2b44b2ab438531824fde751/users/637d22faf9164686a2b79db74225fb00/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.169629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ded8cd-cc63-484a-826a-a4837de364ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=22061a6dd2b44b2ab438531824fde751, user_id=637d22faf9164686a2b79db74225fb00, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.172263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ded8cd-cc63-484a-826a-a4837de364ed admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.220604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e9655e95014bce8624f24f34b36a16'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.221787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e9655e95014bce8624f24f34b36a16'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.235131 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e9655e95014bce8624f24f34b36a16'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.235966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e9655e95014bce8624f24f34b36a16'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.248005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1207/2417] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:37 2022] DELETE /identity/v3/users/40e9655e95014bce8624f24f34b36a16 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:38.248790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.253111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.256103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1211/2418] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:38 2022] PUT /identity/v3/projects/22061a6dd2b44b2ab438531824fde751/users/637d22faf9164686a2b79db74225fb00/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:38.266237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808b17-2877-48f0-bc22-2dd5690bbe82 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.267199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808b17-2877-48f0-bc22-2dd5690bbe82 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.267599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808b17-2877-48f0-bc22-2dd5690bbe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.298544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-70808b17-2877-48f0-bc22-2dd5690bbe82 None None] MFA Rules not processed for user `637d22faf9164686a2b79db74225fb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:38.299889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-70808b17-2877-48f0-bc22-2dd5690bbe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.333004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407599c-b3ad-4f3c-bebe-aa75598344fa admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.375222 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1212/2419] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:38.386443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70808b17-2877-48f0-bc22-2dd5690bbe82 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.388009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-70808b17-2877-48f0-bc22-2dd5690bbe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.395441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c84a-bc74-4212-b308-8e952154a9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.396063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c84a-bc74-4212-b308-8e952154a9cb admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.396370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c84a-bc74-4212-b308-8e952154a9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.396784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c84a-bc74-4212-b308-8e952154a9cb admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.397419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6c84a-bc74-4212-b308-8e952154a9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.399422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6c84a-bc74-4212-b308-8e952154a9cb admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.438178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:38.465539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70808b17-2877-48f0-bc22-2dd5690bbe82 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.471621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b96abf-6fe3-4ed2-bc53-47d8ce934274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.472237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96abf-6fe3-4ed2-bc53-47d8ce934274 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.472545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96abf-6fe3-4ed2-bc53-47d8ce934274 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.472823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96abf-6fe3-4ed2-bc53-47d8ce934274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.479962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1208/2420] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:38 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:38.485698 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b96abf-6fe3-4ed2-bc53-47d8ce934274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.485872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c84a-bc74-4212-b308-8e952154a9cb admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.486049 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b96abf-6fe3-4ed2-bc53-47d8ce934274 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.491800 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c84a-bc74-4212-b308-8e952154a9cb admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.492146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1213/2421] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:38.496421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.497019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.497293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.497563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.498552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.499756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.510794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1209/2422] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:38.518591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b96abf-6fe3-4ed2-bc53-47d8ce934274 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.529056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b96abf-6fe3-4ed2-bc53-47d8ce934274 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.534095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af299cfb-8b26-4f44-b46f-6f22434342fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.535194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299cfb-8b26-4f44-b46f-6f22434342fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.535534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299cfb-8b26-4f44-b46f-6f22434342fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.535810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299cfb-8b26-4f44-b46f-6f22434342fd admin admin] PATH_INFO: `/v3/projects/08de21bedbac4e52a4df6442ed7a1d04/users/ac8a93b162914f9b87490ae8a4a49870/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.552005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af299cfb-8b26-4f44-b46f-6f22434342fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=08de21bedbac4e52a4df6442ed7a1d04, user_id=ac8a93b162914f9b87490ae8a4a49870, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.555319 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af299cfb-8b26-4f44-b46f-6f22434342fd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.571717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.573782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.588778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fa63c-94e6-41c9-9375-c4c671c49ad1 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.595050 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.595736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.596016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.596275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] PATH_INFO: `/v3/projects/81cfe430727747f38a59a54a1ee28893` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.597474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cfe430727747f38a59a54a1ee28893)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.599367 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.623881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1214/2423] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:38 2022] PUT /identity/v3/projects/08de21bedbac4e52a4df6442ed7a1d04/users/ac8a93b162914f9b87490ae8a4a49870/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:38.627883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af299cfb-8b26-4f44-b46f-6f22434342fd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.690293 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af299cfb-8b26-4f44-b46f-6f22434342fd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.695004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e5cd-d82c-4789-944f-cd7c4b1f5115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.695606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e5cd-d82c-4789-944f-cd7c4b1f5115 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.695886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e5cd-d82c-4789-944f-cd7c4b1f5115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.696157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e5cd-d82c-4789-944f-cd7c4b1f5115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.696842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0e5cd-d82c-4789-944f-cd7c4b1f5115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.698423 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0e5cd-d82c-4789-944f-cd7c4b1f5115 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.705315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:38.710155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1215/2424] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:38.714350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e5cd-d82c-4789-944f-cd7c4b1f5115 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.719956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cfe430727747f38a59a54a1ee28893', 'request_id': 'req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.724653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e5cd-d82c-4789-944f-cd7c4b1f5115 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.729081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cfe430727747f38a59a54a1ee28893', 'request_id': 'req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.735832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cfe430727747f38a59a54a1ee28893', 'request_id': 'req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.782124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e9d53-818c-4685-8158-4aefa7bc870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.782818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e9d53-818c-4685-8158-4aefa7bc870a admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.783100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e9d53-818c-4685-8158-4aefa7bc870a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.783373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e9d53-818c-4685-8158-4aefa7bc870a admin admin] PATH_INFO: `/v3/projects/08de21bedbac4e52a4df6442ed7a1d04/users/ac8a93b162914f9b87490ae8a4a49870/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.785370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e9d53-818c-4685-8158-4aefa7bc870a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08de21bedbac4e52a4df6442ed7a1d04, user_id=ac8a93b162914f9b87490ae8a4a49870, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.788060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e9d53-818c-4685-8158-4aefa7bc870a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.799019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1216/2425] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:38 2022] PUT /identity/v3/projects/08de21bedbac4e52a4df6442ed7a1d04/users/ac8a93b162914f9b87490ae8a4a49870/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:38.809054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5569-f0dd-4776-9e88-07af82c7354b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.809340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5569-f0dd-4776-9e88-07af82c7354b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.809615 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5569-f0dd-4776-9e88-07af82c7354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.833501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] The token cache is being invalidate because project 81cfe430727747f38a59a54a1ee28893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:38.833792 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.834438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2fb01316-c21a-4c3e-8ef1-440d137cdfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:38.837501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1210/2426] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:38 2022] DELETE /identity/v3/projects/81cfe430727747f38a59a54a1ee28893 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:38.842432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af24be4-dd7e-4bb1-a380-f1ea792161cd None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.842584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-38cc5569-f0dd-4776-9e88-07af82c7354b None None] MFA Rules not processed for user `ac8a93b162914f9b87490ae8a4a49870`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:38.842863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af24be4-dd7e-4bb1-a380-f1ea792161cd None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.843207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af24be4-dd7e-4bb1-a380-f1ea792161cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.844021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-38cc5569-f0dd-4776-9e88-07af82c7354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.865920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-7af24be4-dd7e-4bb1-a380-f1ea792161cd None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:38.867127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7af24be4-dd7e-4bb1-a380-f1ea792161cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.869969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:38.915674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1217/2427] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:38.928742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1211/2428] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:38.933415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc5569-f0dd-4776-9e88-07af82c7354b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.935023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-38cc5569-f0dd-4776-9e88-07af82c7354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.937718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa803d6-a1a4-4248-87a8-4cbea75d1827 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.938162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa803d6-a1a4-4248-87a8-4cbea75d1827 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.938386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa803d6-a1a4-4248-87a8-4cbea75d1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.958661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-eaa803d6-a1a4-4248-87a8-4cbea75d1827 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:38.959861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-eaa803d6-a1a4-4248-87a8-4cbea75d1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:38.968956 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1212/2429] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:38.973440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa803d6-a1a4-4248-87a8-4cbea75d1827 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:38.982212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa803d6-a1a4-4248-87a8-4cbea75d1827 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:38.987603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:38.988193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:38.988496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:38.988769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:38.989415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:38.989716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:38.991309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:38.997030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc5569-f0dd-4776-9e88-07af82c7354b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:39.001807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0bb0f-c25b-4643-9fb3-945d086d7f6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:39.002482 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0bb0f-c25b-4643-9fb3-945d086d7f6b service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.002828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0bb0f-c25b-4643-9fb3-945d086d7f6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.003167 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0bb0f-c25b-4643-9fb3-945d086d7f6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.003309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1213/2430] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:29:39.007459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:39.012960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0bb0f-c25b-4643-9fb3-945d086d7f6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:39.014546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0bb0f-c25b-4643-9fb3-945d086d7f6b service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:39.016939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccb4c6-46dd-4458-ba4b-f4f3f3b2d1fe admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:39.022808 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2424ff-ae95-4af8-9e94-d611df6a4b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:39.023392 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2424ff-ae95-4af8-9e94-d611df6a4b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.023752 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2424ff-ae95-4af8-9e94-d611df6a4b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.024029 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2424ff-ae95-4af8-9e94-d611df6a4b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.024685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2424ff-ae95-4af8-9e94-d611df6a4b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:39.024881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1218/2431] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:39.026625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2424ff-ae95-4af8-9e94-d611df6a4b11 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:39.162391 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1214/2432] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:39 2022] POST /identity/v3/projects => generated 359 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:39.164912 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0bb0f-c25b-4643-9fb3-945d086d7f6b service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:39.175825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0bb0f-c25b-4643-9fb3-945d086d7f6b service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:39.246091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696370-25f9-41e4-9318-51441680d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:39.246714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696370-25f9-41e4-9318-51441680d2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.246997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696370-25f9-41e4-9318-51441680d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.247274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696370-25f9-41e4-9318-51441680d2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.247900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696370-25f9-41e4-9318-51441680d2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:39.249864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696370-25f9-41e4-9318-51441680d2e5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:39.329395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1219/2433] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:39 2022] POST /identity/v3/users => generated 280 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:39.333209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2424ff-ae95-4af8-9e94-d611df6a4b11 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:39.343390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2424ff-ae95-4af8-9e94-d611df6a4b11 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:39.348411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86f90-94fe-4cba-b8be-95fca7cbf318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:39.349010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86f90-94fe-4cba-b8be-95fca7cbf318 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.349289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86f90-94fe-4cba-b8be-95fca7cbf318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.349564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86f90-94fe-4cba-b8be-95fca7cbf318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.350206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb86f90-94fe-4cba-b8be-95fca7cbf318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:39.351801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb86f90-94fe-4cba-b8be-95fca7cbf318 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:39.361742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1215/2434] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:39.365592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696370-25f9-41e4-9318-51441680d2e5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:39.375624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696370-25f9-41e4-9318-51441680d2e5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:39.380848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8a263-694d-4ddd-9e43-f557b41249ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:39.381455 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8a263-694d-4ddd-9e43-f557b41249ea admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.381736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8a263-694d-4ddd-9e43-f557b41249ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.382010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8a263-694d-4ddd-9e43-f557b41249ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.382686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8a263-694d-4ddd-9e43-f557b41249ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:39.384262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8a263-694d-4ddd-9e43-f557b41249ea admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:39.395075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1220/2435] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:39.402318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86f90-94fe-4cba-b8be-95fca7cbf318 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:39.412180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86f90-94fe-4cba-b8be-95fca7cbf318 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:39.417048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:39.417711 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.418048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.418322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] PATH_INFO: `/v3/projects/c25a3f99477f4b7eb75d7497a8cf5418/users/4c596ce119d4496ca309259378830794/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.434060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25a3f99477f4b7eb75d7497a8cf5418, user_id=4c596ce119d4496ca309259378830794, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:39.436961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:39.543730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1216/2436] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:39 2022] PUT /identity/v3/projects/c25a3f99477f4b7eb75d7497a8cf5418/users/4c596ce119d4496ca309259378830794/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:39.554587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d709a4-1004-43c2-a15d-95d73ad1ae8d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.555061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d709a4-1004-43c2-a15d-95d73ad1ae8d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.555161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d709a4-1004-43c2-a15d-95d73ad1ae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.584394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d8d709a4-1004-43c2-a15d-95d73ad1ae8d None None] MFA Rules not processed for user `4c596ce119d4496ca309259378830794`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:39.585886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d8d709a4-1004-43c2-a15d-95d73ad1ae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:39.618866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:39.653916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1221/2437] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:39.689862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:39.692558 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:39.738020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:39.752637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99d073-2bd9-41d5-a871-ce03b06fd379 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:39.756246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289bbd-fbfd-4450-9a0f-b8c95834d75f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:39.756893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289bbd-fbfd-4450-9a0f-b8c95834d75f service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.757168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289bbd-fbfd-4450-9a0f-b8c95834d75f service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.757441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289bbd-fbfd-4450-9a0f-b8c95834d75f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.765566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289bbd-fbfd-4450-9a0f-b8c95834d75f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:39.767081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289bbd-fbfd-4450-9a0f-b8c95834d75f service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:39.776540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1217/2438] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:39.791950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d709a4-1004-43c2-a15d-95d73ad1ae8d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:39.856166 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d709a4-1004-43c2-a15d-95d73ad1ae8d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:39.861491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:39.862150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:39.862429 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:39.862701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] PATH_INFO: `/v3/users/4c596ce119d4496ca309259378830794` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:39.863826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c596ce119d4496ca309259378830794)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:39.865985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:40.044787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c596ce119d4496ca309259378830794'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.045488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c596ce119d4496ca309259378830794'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.074557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289bbd-fbfd-4450-9a0f-b8c95834d75f service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:40.118206 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c596ce119d4496ca309259378830794'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.125798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c596ce119d4496ca309259378830794'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.137962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cde150fa-f09a-4c07-be16-3fc70dcee782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c596ce119d4496ca309259378830794'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.138429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289bbd-fbfd-4450-9a0f-b8c95834d75f service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:40.143461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8a93b162914f9b87490ae8a4a49870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08de21bedbac4e52a4df6442ed7a1d04', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:40.144069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:40.144390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:40.144677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:40.145665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:40.145974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:40.147727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:40.149068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1222/2439] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:39 2022] DELETE /identity/v3/users/4c596ce119d4496ca309259378830794 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:40.151069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c8c7a-3628-4bef-95a5-4fb1aa9a1a1d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:40.155919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c8c7a-3628-4bef-95a5-4fb1aa9a1a1d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:40.155919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c8c7a-3628-4bef-95a5-4fb1aa9a1a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:40.163269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1218/2440] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:29:40.164215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:40.165934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:40.172395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-784c8c7a-3628-4bef-95a5-4fb1aa9a1a1d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:40.174299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-784c8c7a-3628-4bef-95a5-4fb1aa9a1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:40.179582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358afcbd-1bac-46bf-bb0d-b7f8cdc747c8 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:40.220697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:40.234876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1223/2441] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:40.236778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7095a-0a6a-44d9-aca8-e88ca366793c tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8a93b162914f9b87490ae8a4a49870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08de21bedbac4e52a4df6442ed7a1d04', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:40.237466 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7095a-0a6a-44d9-aca8-e88ca366793c tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:40.237866 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7095a-0a6a-44d9-aca8-e88ca366793c tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:40.238159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7095a-0a6a-44d9-aca8-e88ca366793c tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:40.238971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7095a-0a6a-44d9-aca8-e88ca366793c tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:40.241132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7095a-0a6a-44d9-aca8-e88ca366793c tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:40.245336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c8c7a-3628-4bef-95a5-4fb1aa9a1a1d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:40.246934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-784c8c7a-3628-4bef-95a5-4fb1aa9a1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:40.309141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c8c7a-3628-4bef-95a5-4fb1aa9a1a1d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:40.313393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33100aa-e593-40d2-bccb-76535c28148d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:40.314200 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33100aa-e593-40d2-bccb-76535c28148d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:40.314488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33100aa-e593-40d2-bccb-76535c28148d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:40.314759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33100aa-e593-40d2-bccb-76535c28148d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:40.326320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33100aa-e593-40d2-bccb-76535c28148d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:40.328788 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33100aa-e593-40d2-bccb-76535c28148d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:40.347217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1224/2442] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:40.500257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1219/2443] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:40 2022] POST /identity/v3/projects => generated 352 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:40.503428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33100aa-e593-40d2-bccb-76535c28148d service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:40.513574 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33100aa-e593-40d2-bccb-76535c28148d service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:40.569163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8a93b162914f9b87490ae8a4a49870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08de21bedbac4e52a4df6442ed7a1d04', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:40.569823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:40.570057 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:40.570336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:40.570989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:40.571294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:40.572918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:40.584765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1225/2444] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:29:40.621049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7095a-0a6a-44d9-aca8-e88ca366793c tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:40.631225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7095a-0a6a-44d9-aca8-e88ca366793c tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:40.635751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8a93b162914f9b87490ae8a4a49870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08de21bedbac4e52a4df6442ed7a1d04', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:40.636410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:40.636693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:40.636966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] PATH_INFO: `/v3/projects/03ff24a380224c1dab56793a85ddafe0` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:40.638077 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Authorizing `identity:delete_project(project_id=03ff24a380224c1dab56793a85ddafe0)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:40.639972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:40.819588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ff24a380224c1dab56793a85ddafe0', 'request_id': 'req-5707c69c-b48c-4e0e-be1a-d6f2118e560b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.827220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ff24a380224c1dab56793a85ddafe0', 'request_id': 'req-5707c69c-b48c-4e0e-be1a-d6f2118e560b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.828853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:40.833794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ff24a380224c1dab56793a85ddafe0', 'request_id': 'req-5707c69c-b48c-4e0e-be1a-d6f2118e560b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.944082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] The token cache is being invalidate because project 03ff24a380224c1dab56793a85ddafe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:40.944082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.944082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5707c69c-b48c-4e0e-be1a-d6f2118e560b tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:40.944082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1220/2445] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:40 2022] DELETE /identity/v3/projects/03ff24a380224c1dab56793a85ddafe0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:41.062582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:41.065128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:41.144228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcfb1-38c4-4783-9ce1-5a48ebccffa7 tempest-VolumeQuotaClassesTest-920178301 tempest-VolumeQuotaClassesTest-920178301-project-admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:41.203614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:41.204404 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:41.204684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:41.204958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] PATH_INFO: `/v3/projects/c25a3f99477f4b7eb75d7497a8cf5418` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:41.206096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25a3f99477f4b7eb75d7497a8cf5418)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:41.208041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:41.323835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25a3f99477f4b7eb75d7497a8cf5418', 'request_id': 'req-53a34493-3ad6-47e7-ad13-af7258d50129'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:41.329240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25a3f99477f4b7eb75d7497a8cf5418', 'request_id': 'req-53a34493-3ad6-47e7-ad13-af7258d50129'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:41.335278 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25a3f99477f4b7eb75d7497a8cf5418', 'request_id': 'req-53a34493-3ad6-47e7-ad13-af7258d50129'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:41.444281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] The token cache is being invalidate because project c25a3f99477f4b7eb75d7497a8cf5418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:41.448516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:41.448516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-53a34493-3ad6-47e7-ad13-af7258d50129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:41.448516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1226/2446] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:41 2022] DELETE /identity/v3/projects/c25a3f99477f4b7eb75d7497a8cf5418 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:41.451935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af68b6-f7c9-4f25-8945-78471ee0de88 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:41.452220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af68b6-f7c9-4f25-8945-78471ee0de88 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:41.452527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af68b6-f7c9-4f25-8945-78471ee0de88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:41.474517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-58af68b6-f7c9-4f25-8945-78471ee0de88 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:41.475729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-58af68b6-f7c9-4f25-8945-78471ee0de88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:41.538809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1221/2447] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:41.546727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141fa1-6157-4310-bb1d-5406f4737fbb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:41.547016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141fa1-6157-4310-bb1d-5406f4737fbb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:41.547294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141fa1-6157-4310-bb1d-5406f4737fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:41.567340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-81141fa1-6157-4310-bb1d-5406f4737fbb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:41.568586 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-81141fa1-6157-4310-bb1d-5406f4737fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:41.576363 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1227/2448] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:41.580824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af68b6-f7c9-4f25-8945-78471ee0de88 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:41.590553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af68b6-f7c9-4f25-8945-78471ee0de88 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:41.596127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:41.596778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:41.597973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:41.597973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:41.597973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:41.598252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:41.599831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:41.616222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1222/2449] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:29:41.617315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141fa1-6157-4310-bb1d-5406f4737fbb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:41.619345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:41.621306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:41.624369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:41.628587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141fa1-6157-4310-bb1d-5406f4737fbb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:41.633774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1389b-6dd0-4077-b7cc-e9d8d6c3eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:41.634334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708f623-2daa-43bb-811f-23cdf585b48a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:41.634462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1389b-6dd0-4077-b7cc-e9d8d6c3eeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:41.634678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1389b-6dd0-4077-b7cc-e9d8d6c3eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:41.634955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1389b-6dd0-4077-b7cc-e9d8d6c3eeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:41.635589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1389b-6dd0-4077-b7cc-e9d8d6c3eeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:41.637514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1389b-6dd0-4077-b7cc-e9d8d6c3eeb8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:41.639695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:41.640370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:41.640625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:41.640920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] PATH_INFO: `/v3/users/bb44156285df4e2b80dc732531d3f459` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:41.642081 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb44156285df4e2b80dc732531d3f459)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:41.644056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:41.770827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1228/2450] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:41 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:41.774893 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1389b-6dd0-4077-b7cc-e9d8d6c3eeb8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:41.838149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1389b-6dd0-4077-b7cc-e9d8d6c3eeb8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:41.842693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:41.843331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:41.843601 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:41.843870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:41.844519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:41.846550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:41.913805 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb44156285df4e2b80dc732531d3f459'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.015014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1229/2451] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:41 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:42.015842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.017966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.020985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb44156285df4e2b80dc732531d3f459'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.021664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb44156285df4e2b80dc732531d3f459'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.030454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42448328-95a3-4341-9f99-6007ca27e662 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.034874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb44156285df4e2b80dc732531d3f459'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.035517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb44156285df4e2b80dc732531d3f459'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.035796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.036480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.036767 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.037044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] PATH_INFO: `/v3/users/637d22faf9164686a2b79db74225fb00` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.038189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=637d22faf9164686a2b79db74225fb00)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.040104 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.047938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1223/2452] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:41 2022] DELETE /identity/v3/users/bb44156285df4e2b80dc732531d3f459 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:42.049005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.050509 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.114852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b10ee3-14d3-4e18-8639-565f5ed3f408 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.119556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebad943-326c-4ca4-b7fd-884c269fd333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.120142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebad943-326c-4ca4-b7fd-884c269fd333 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.120451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebad943-326c-4ca4-b7fd-884c269fd333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.120721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebad943-326c-4ca4-b7fd-884c269fd333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.121356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebad943-326c-4ca4-b7fd-884c269fd333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.123047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebad943-326c-4ca4-b7fd-884c269fd333 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.126672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:42.132609 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1224/2453] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:42.133959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be64d-c1db-44bf-a543-4e2eed003306 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.134240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be64d-c1db-44bf-a543-4e2eed003306 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.134507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73be64d-c1db-44bf-a543-4e2eed003306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.154308 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a73be64d-c1db-44bf-a543-4e2eed003306 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:42.155493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a73be64d-c1db-44bf-a543-4e2eed003306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.163991 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1225/2454] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:42.164919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73be64d-c1db-44bf-a543-4e2eed003306 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.174829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73be64d-c1db-44bf-a543-4e2eed003306 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.179700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.180294 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.180607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.180875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.181515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.183123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.193809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1226/2455] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:42.194591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.196192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.197410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637d22faf9164686a2b79db74225fb00'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.198086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637d22faf9164686a2b79db74225fb00'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.211035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:42.253035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc07d90-b8b6-4f6d-bda1-50a5395dfcd7 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.256846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.257436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.257712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.257980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.259736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.266131 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637d22faf9164686a2b79db74225fb00'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.272238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.273705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.274720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637d22faf9164686a2b79db74225fb00'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.283374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1227/2456] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:42.288477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.288477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.288696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fddf55a3-4bc0-489d-8af4-f36ed61f6b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637d22faf9164686a2b79db74225fb00'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.293717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1230/2457] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:42 2022] DELETE /identity/v3/users/637d22faf9164686a2b79db74225fb00 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:42.297666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079222d-e599-40e8-8727-116ee41b1d82 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.298147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ecf68-4fc0-415d-9d4f-e1596ec9b19f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.298495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ecf68-4fc0-415d-9d4f-e1596ec9b19f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.298772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ecf68-4fc0-415d-9d4f-e1596ec9b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.320004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a74ecf68-4fc0-415d-9d4f-e1596ec9b19f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:42.321244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a74ecf68-4fc0-415d-9d4f-e1596ec9b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.362846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf164138-89a2-4aad-8edd-07fefada321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.363936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164138-89a2-4aad-8edd-07fefada321b admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.364221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164138-89a2-4aad-8edd-07fefada321b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.364529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf164138-89a2-4aad-8edd-07fefada321b admin admin] PATH_INFO: `/v3/projects/244ee38ce9f1416f8a187bf2e97b77f8/users/11b3416a31b44fb5a08e3f0aaf4e30ce/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.380126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf164138-89a2-4aad-8edd-07fefada321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=244ee38ce9f1416f8a187bf2e97b77f8, user_id=11b3416a31b44fb5a08e3f0aaf4e30ce, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.382831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf164138-89a2-4aad-8edd-07fefada321b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.386701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1231/2458] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:42.396998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ecf68-4fc0-415d-9d4f-e1596ec9b19f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.398357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a74ecf68-4fc0-415d-9d4f-e1596ec9b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.444718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1228/2459] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:42 2022] PUT /identity/v3/projects/244ee38ce9f1416f8a187bf2e97b77f8/users/11b3416a31b44fb5a08e3f0aaf4e30ce/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:42.455380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ecf68-4fc0-415d-9d4f-e1596ec9b19f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.456826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a58f-493a-4e54-bf2b-2d2118d932e4 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.457119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a58f-493a-4e54-bf2b-2d2118d932e4 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.457398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a58f-493a-4e54-bf2b-2d2118d932e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.488830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-9833a58f-493a-4e54-bf2b-2d2118d932e4 None None] MFA Rules not processed for user `11b3416a31b44fb5a08e3f0aaf4e30ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:42.490130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9833a58f-493a-4e54-bf2b-2d2118d932e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.509675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419357fe-c720-4f8f-8f20-15c9883d1cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.510305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419357fe-c720-4f8f-8f20-15c9883d1cba service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.510612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419357fe-c720-4f8f-8f20-15c9883d1cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.510942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419357fe-c720-4f8f-8f20-15c9883d1cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.573514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1229/2460] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:42.577670 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833a58f-493a-4e54-bf2b-2d2118d932e4 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.581037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419357fe-c720-4f8f-8f20-15c9883d1cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.583001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419357fe-c720-4f8f-8f20-15c9883d1cba service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.591056 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833a58f-493a-4e54-bf2b-2d2118d932e4 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.593420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1232/2461] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:42.599997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.600901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.601353 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.602122 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.603290 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.605427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.685164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1230/2462] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:42 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:42.689119 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419357fe-c720-4f8f-8f20-15c9883d1cba service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.699481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419357fe-c720-4f8f-8f20-15c9883d1cba service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.708276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.709661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:42.765506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7b31-a638-4741-884f-284e47ef821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.766138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7b31-a638-4741-884f-284e47ef821a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.766418 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7b31-a638-4741-884f-284e47ef821a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.767235 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7b31-a638-4741-884f-284e47ef821a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.767851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c7b31-a638-4741-884f-284e47ef821a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.769817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c7b31-a638-4741-884f-284e47ef821a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.779380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384adf50-75f3-4e35-b84f-8fddc4e71216 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.785961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.792908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.792908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.792908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] PATH_INFO: `/v3/projects/730bafa411514929ac48c91d0d028569` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.792908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=730bafa411514929ac48c91d0d028569)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.792908 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.867480 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1233/2463] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:42 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:42.871369 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7b31-a638-4741-884f-284e47ef821a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.880938 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7b31-a638-4741-884f-284e47ef821a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.886433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f16dc-762f-4bc1-8c0d-134fa361544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.887301 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f16dc-762f-4bc1-8c0d-134fa361544a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.887510 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f16dc-762f-4bc1-8c0d-134fa361544a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.887793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f16dc-762f-4bc1-8c0d-134fa361544a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.888611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f16dc-762f-4bc1-8c0d-134fa361544a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.893018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f16dc-762f-4bc1-8c0d-134fa361544a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.902901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1234/2464] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:42.907937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f16dc-762f-4bc1-8c0d-134fa361544a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:42.918391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f16dc-762f-4bc1-8c0d-134fa361544a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:42.931806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '730bafa411514929ac48c91d0d028569', 'request_id': 'req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.939288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '730bafa411514929ac48c91d0d028569', 'request_id': 'req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.948941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '730bafa411514929ac48c91d0d028569', 'request_id': 'req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:42.958901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:42.982154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9b0f-661c-47da-a405-e698098bc858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:42.985240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9b0f-661c-47da-a405-e698098bc858 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:42.985240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9b0f-661c-47da-a405-e698098bc858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:42.985240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9b0f-661c-47da-a405-e698098bc858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:42.985240 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9b0f-661c-47da-a405-e698098bc858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:42.985655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9b0f-661c-47da-a405-e698098bc858 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:42.995825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1235/2465] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:43.000137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9b0f-661c-47da-a405-e698098bc858 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.010425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9b0f-661c-47da-a405-e698098bc858 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.015161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.015797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.016076 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.016389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] PATH_INFO: `/v3/projects/36afcc164efc40259e7b706d8803cf67/users/2ea0591e430940b985795469c3f62c59/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.033434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36afcc164efc40259e7b706d8803cf67, user_id=2ea0591e430940b985795469c3f62c59, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.036160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.048587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] The token cache is being invalidate because project 730bafa411514929ac48c91d0d028569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:43.053970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.053970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.053970 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1231/2466] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:42 2022] DELETE /identity/v3/projects/730bafa411514929ac48c91d0d028569 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:43.054823 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.056110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:43.068603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58f1d6-0bba-4982-b3fc-5f3eb8dd0994 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.073298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.073901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.074177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.074460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] PATH_INFO: `/v3/users/ac8a93b162914f9b87490ae8a4a49870` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.075543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8a93b162914f9b87490ae8a4a49870)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.077596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.119147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1236/2467] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:42 2022] PUT /identity/v3/projects/36afcc164efc40259e7b706d8803cf67/users/2ea0591e430940b985795469c3f62c59/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:43.124849 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.126638 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:43.186093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:43.192235 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ce376-6e97-4374-b59e-ce357c5b84b1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.196988 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58794808-112f-4199-8011-734813275a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.197613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794808-112f-4199-8011-734813275a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.197890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794808-112f-4199-8011-734813275a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.198160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794808-112f-4199-8011-734813275a2a admin admin] PATH_INFO: `/v3/projects/22061a6dd2b44b2ab438531824fde751` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.199277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58794808-112f-4199-8011-734813275a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22061a6dd2b44b2ab438531824fde751)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.201186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58794808-112f-4199-8011-734813275a2a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.290799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8a93b162914f9b87490ae8a4a49870'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.323335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58794808-112f-4199-8011-734813275a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22061a6dd2b44b2ab438531824fde751', 'request_id': 'req-58794808-112f-4199-8011-734813275a2a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.328774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58794808-112f-4199-8011-734813275a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22061a6dd2b44b2ab438531824fde751', 'request_id': 'req-58794808-112f-4199-8011-734813275a2a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.334916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58794808-112f-4199-8011-734813275a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22061a6dd2b44b2ab438531824fde751', 'request_id': 'req-58794808-112f-4199-8011-734813275a2a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.363229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8a93b162914f9b87490ae8a4a49870'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.363845 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8a93b162914f9b87490ae8a4a49870'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.376477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8a93b162914f9b87490ae8a4a49870'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.377201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-3cb23f93-aa0a-49ec-b269-3908d0f4dcfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8a93b162914f9b87490ae8a4a49870'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.389664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1232/2468] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:43 2022] DELETE /identity/v3/users/ac8a93b162914f9b87490ae8a4a49870 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:43.392615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8315de-d018-4931-8047-5216df29a3d7 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.397084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8315de-d018-4931-8047-5216df29a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.397084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8315de-d018-4931-8047-5216df29a3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.421537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-4b8315de-d018-4931-8047-5216df29a3d7 None None] MFA Rules not processed for user `2ea0591e430940b985795469c3f62c59`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:43.428234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4b8315de-d018-4931-8047-5216df29a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:43.454336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58794808-112f-4199-8011-734813275a2a admin admin] The token cache is being invalidate because project 22061a6dd2b44b2ab438531824fde751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:43.454654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58794808-112f-4199-8011-734813275a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.455311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58794808-112f-4199-8011-734813275a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:43.456978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1237/2469] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:43 2022] DELETE /identity/v3/projects/22061a6dd2b44b2ab438531824fde751 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:43.461836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f938-f67c-49db-882f-6d5932377508 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.462224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f938-f67c-49db-882f-6d5932377508 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.462568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f938-f67c-49db-882f-6d5932377508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.484129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b4f7f938-f67c-49db-882f-6d5932377508 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:43.486030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b4f7f938-f67c-49db-882f-6d5932377508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:43.493212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1233/2470] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:43.497662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8315de-d018-4931-8047-5216df29a3d7 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.499023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4b8315de-d018-4931-8047-5216df29a3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:43.546531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1238/2471] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:43.556065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbbd53-8d4b-4ce9-8487-d52c4ec6f439 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.556408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbbd53-8d4b-4ce9-8487-d52c4ec6f439 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.556780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbbd53-8d4b-4ce9-8487-d52c4ec6f439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.573181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8315de-d018-4931-8047-5216df29a3d7 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.578003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e87c3-c998-4b3d-b0c6-6da3c2c717eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.578616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e87c3-c998-4b3d-b0c6-6da3c2c717eb admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.578912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e87c3-c998-4b3d-b0c6-6da3c2c717eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.579701 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e87c3-c998-4b3d-b0c6-6da3c2c717eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.579893 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e87c3-c998-4b3d-b0c6-6da3c2c717eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.580677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6fbbbd53-8d4b-4ce9-8487-d52c4ec6f439 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:43.581894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6fbbbd53-8d4b-4ce9-8487-d52c4ec6f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:43.582415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e87c3-c998-4b3d-b0c6-6da3c2c717eb admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.593643 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1239/2472] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:43.594735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbbd53-8d4b-4ce9-8487-d52c4ec6f439 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.604133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbbd53-8d4b-4ce9-8487-d52c4ec6f439 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.614149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.614891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.615098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.615722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.616419 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:43.616723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.618363 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.632873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1240/2473] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:29:43.637261 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.647579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06737-c35f-4288-9caa-6ba443612956 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.652125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6544-05f2-4bed-9e44-655b0ef20135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.652858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6544-05f2-4bed-9e44-655b0ef20135 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.653140 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6544-05f2-4bed-9e44-655b0ef20135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.653411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6544-05f2-4bed-9e44-655b0ef20135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.654030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6544-05f2-4bed-9e44-655b0ef20135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.656589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6544-05f2-4bed-9e44-655b0ef20135 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.685366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1234/2474] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:43 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:43.689268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e87c3-c998-4b3d-b0c6-6da3c2c717eb admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.751220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e87c3-c998-4b3d-b0c6-6da3c2c717eb admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.755799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.756435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.756742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.757038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.757657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.759551 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.763288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1241/2475] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:43 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:43.766915 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6544-05f2-4bed-9e44-655b0ef20135 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.786636 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:43.826592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6544-05f2-4bed-9e44-655b0ef20135 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.831350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037a0f-7439-47db-a56b-79e20f4d17be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.831954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037a0f-7439-47db-a56b-79e20f4d17be admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.832232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037a0f-7439-47db-a56b-79e20f4d17be admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.832535 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037a0f-7439-47db-a56b-79e20f4d17be admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.833156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93037a0f-7439-47db-a56b-79e20f4d17be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.835154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93037a0f-7439-47db-a56b-79e20f4d17be admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.873714 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:43.880026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1235/2476] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:43 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:43.882001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.883884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:43.896030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f56bf-a049-48d2-b5f1-b0869c62cddb admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.900992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.901647 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.901958 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.902232 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] PATH_INFO: `/v3/projects/08de21bedbac4e52a4df6442ed7a1d04` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.903375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08de21bedbac4e52a4df6442ed7a1d04)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.905402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.946725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1242/2477] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:43 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:43.947501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037a0f-7439-47db-a56b-79e20f4d17be admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.957554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037a0f-7439-47db-a56b-79e20f4d17be admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.962156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9c648-615f-4b9c-8593-190af4bc42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.967624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9c648-615f-4b9c-8593-190af4bc42bc admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.967624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9c648-615f-4b9c-8593-190af4bc42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.967624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9c648-615f-4b9c-8593-190af4bc42bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.967624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9c648-615f-4b9c-8593-190af4bc42bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.967624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9c648-615f-4b9c-8593-190af4bc42bc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:43.976263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1243/2478] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:43.977078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9c648-615f-4b9c-8593-190af4bc42bc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:43.987344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9c648-615f-4b9c-8593-190af4bc42bc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:43.992205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d43bb-55d1-43bd-a739-458dc067c0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:43.992820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d43bb-55d1-43bd-a739-458dc067c0dd admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:43.993102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d43bb-55d1-43bd-a739-458dc067c0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:43.993379 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d43bb-55d1-43bd-a739-458dc067c0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:43.994004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d43bb-55d1-43bd-a739-458dc067c0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:43.995583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d43bb-55d1-43bd-a739-458dc067c0dd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.006336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1244/2479] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:44.007162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d43bb-55d1-43bd-a739-458dc067c0dd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.016569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d43bb-55d1-43bd-a739-458dc067c0dd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.021512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82789468-7dcf-41d2-9a65-d0aaa87474ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.022128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82789468-7dcf-41d2-9a65-d0aaa87474ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.022408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82789468-7dcf-41d2-9a65-d0aaa87474ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.022685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82789468-7dcf-41d2-9a65-d0aaa87474ff admin admin] PATH_INFO: `/v3/projects/080d922be7c14bf0baf7c8e83433c71a/users/f4daa8a3e1dd49d7ad88a2f87358e694/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.037361 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82789468-7dcf-41d2-9a65-d0aaa87474ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=080d922be7c14bf0baf7c8e83433c71a, user_id=f4daa8a3e1dd49d7ad88a2f87358e694, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.039956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82789468-7dcf-41d2-9a65-d0aaa87474ff admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.095993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1245/2480] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:44 2022] PUT /identity/v3/projects/080d922be7c14bf0baf7c8e83433c71a/users/f4daa8a3e1dd49d7ad88a2f87358e694/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:44.096856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82789468-7dcf-41d2-9a65-d0aaa87474ff admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.103953 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08de21bedbac4e52a4df6442ed7a1d04', 'request_id': 'req-dae197fa-d1d3-4834-88db-be6e42e77081'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:44.110586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08de21bedbac4e52a4df6442ed7a1d04', 'request_id': 'req-dae197fa-d1d3-4834-88db-be6e42e77081'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:44.116286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08de21bedbac4e52a4df6442ed7a1d04', 'request_id': 'req-dae197fa-d1d3-4834-88db-be6e42e77081'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:44.158648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82789468-7dcf-41d2-9a65-d0aaa87474ff admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.163395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] The token cache is being invalidate because project 08de21bedbac4e52a4df6442ed7a1d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:44.163884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:44.164326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:44.165820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1236/2481] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:43 2022] DELETE /identity/v3/projects/08de21bedbac4e52a4df6442ed7a1d04 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:44.166561 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.167819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:44.216957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7509be-ad96-424c-b140-dde2d699c6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.217779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7509be-ad96-424c-b140-dde2d699c6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.218169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7509be-ad96-424c-b140-dde2d699c6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.218578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7509be-ad96-424c-b140-dde2d699c6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.219608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7509be-ad96-424c-b140-dde2d699c6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.222519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7509be-ad96-424c-b140-dde2d699c6e9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.231345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae197fa-d1d3-4834-88db-be6e42e77081 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.233651 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1246/2482] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:44.237653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086de6-dea8-4a77-86e8-21ff09ddb6ff None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.237653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086de6-dea8-4a77-86e8-21ff09ddb6ff None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.237653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086de6-dea8-4a77-86e8-21ff09ddb6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.237974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.237974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.237974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.237974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.238926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.240541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.251044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1237/2483] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:44.252061 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.255806 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:44.256082 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6e086de6-dea8-4a77-86e8-21ff09ddb6ff None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:44.257346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6e086de6-dea8-4a77-86e8-21ff09ddb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:44.265218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1247/2484] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:44.265978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086de6-dea8-4a77-86e8-21ff09ddb6ff None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.269729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d865cf0-8cb8-4a74-99d0-3acf5751083a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.275478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe3919-b50b-47e0-940a-d123344501d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.276166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe3919-b50b-47e0-940a-d123344501d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.276473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe3919-b50b-47e0-940a-d123344501d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.276596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086de6-dea8-4a77-86e8-21ff09ddb6ff None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.276747 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe3919-b50b-47e0-940a-d123344501d0 admin admin] PATH_INFO: `/v3/projects/9d8e911bcf254dfaba1c8e26066dd281/users/9f2541af2656418e82f89271b77754d3/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.281198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a79be-9890-4498-83eb-2e3f54707817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.281857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a79be-9890-4498-83eb-2e3f54707817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.282259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a79be-9890-4498-83eb-2e3f54707817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.283192 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a79be-9890-4498-83eb-2e3f54707817 admin admin] PATH_INFO: `/v3/projects/080d922be7c14bf0baf7c8e83433c71a/users/f4daa8a3e1dd49d7ad88a2f87358e694/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.285281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a79be-9890-4498-83eb-2e3f54707817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080d922be7c14bf0baf7c8e83433c71a, user_id=f4daa8a3e1dd49d7ad88a2f87358e694, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.287882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a79be-9890-4498-83eb-2e3f54707817 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.292596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe3919-b50b-47e0-940a-d123344501d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8e911bcf254dfaba1c8e26066dd281, user_id=9f2541af2656418e82f89271b77754d3, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.295213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe3919-b50b-47e0-940a-d123344501d0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.308214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1248/2485] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:44 2022] PUT /identity/v3/projects/080d922be7c14bf0baf7c8e83433c71a/users/f4daa8a3e1dd49d7ad88a2f87358e694/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:44.308214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a04106-a019-4a81-9b47-bb40bf94839d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.308214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a04106-a019-4a81-9b47-bb40bf94839d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.308214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a04106-a019-4a81-9b47-bb40bf94839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.404550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1238/2486] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:44 2022] PUT /identity/v3/projects/9d8e911bcf254dfaba1c8e26066dd281/users/9f2541af2656418e82f89271b77754d3/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:44.406207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9093-a234-48f3-9c06-8c6c2f780eb8 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.406721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9093-a234-48f3-9c06-8c6c2f780eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.406984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9093-a234-48f3-9c06-8c6c2f780eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.412603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:44.435074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:44.440144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-336c9093-a234-48f3-9c06-8c6c2f780eb8 None None] MFA Rules not processed for user `f4daa8a3e1dd49d7ad88a2f87358e694`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:44.441379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-336c9093-a234-48f3-9c06-8c6c2f780eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:44.445532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c1a04106-a019-4a81-9b47-bb40bf94839d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:44.446698 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c1a04106-a019-4a81-9b47-bb40bf94839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:44.507909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1249/2487] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:44.509196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b115f-dbce-46ca-a368-3b67265c14dd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.509812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b115f-dbce-46ca-a368-3b67265c14dd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.509812 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b115f-dbce-46ca-a368-3b67265c14dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.511248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1239/2488] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:44.512968 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c9093-a234-48f3-9c06-8c6c2f780eb8 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.526120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c9093-a234-48f3-9c06-8c6c2f780eb8 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.530943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.531541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.531824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.532771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.533483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:44.533785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.535376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.540649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-323b115f-dbce-46ca-a368-3b67265c14dd None None] MFA Rules not processed for user `9f2541af2656418e82f89271b77754d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:44.541850 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-323b115f-dbce-46ca-a368-3b67265c14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:44.546985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1240/2489] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:29:44.547785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.550262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:44.606239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1250/2490] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:44.607926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b115f-dbce-46ca-a368-3b67265c14dd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.611446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ceb20-b387-4541-89e7-86fc48654e79 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.615095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.615696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.615971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.616239 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.618005 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:44.621044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b115f-dbce-46ca-a368-3b67265c14dd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.626656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe79c-ad5e-4f3d-b276-2b9cf10b7fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.628248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe79c-ad5e-4f3d-b276-2b9cf10b7fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.628248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe79c-ad5e-4f3d-b276-2b9cf10b7fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.628248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe79c-ad5e-4f3d-b276-2b9cf10b7fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.628661 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafe79c-ad5e-4f3d-b276-2b9cf10b7fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.630501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafe79c-ad5e-4f3d-b276-2b9cf10b7fb7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.644851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:44.666891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:44.678256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.679687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.688938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1241/2491] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:44.689696 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.696374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1251/2492] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:44 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:44.699926 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87080ca9-2991-4f38-9310-369755a57207 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.700613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe79c-ad5e-4f3d-b276-2b9cf10b7fb7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.763083 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a3d0a-5e14-471e-8068-22add143b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.763753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a3d0a-5e14-471e-8068-22add143b4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.764008 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a3d0a-5e14-471e-8068-22add143b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.764291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a3d0a-5e14-471e-8068-22add143b4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.766049 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a3d0a-5e14-471e-8068-22add143b4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.768003 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a3d0a-5e14-471e-8068-22add143b4d3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.771411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe79c-ad5e-4f3d-b276-2b9cf10b7fb7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.776283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfe7b4-65ce-4adf-bff0-8abe9ea7e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.777026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe7b4-65ce-4adf-bff0-8abe9ea7e71f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.777437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe7b4-65ce-4adf-bff0-8abe9ea7e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.777715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfe7b4-65ce-4adf-bff0-8abe9ea7e71f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.778332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfe7b4-65ce-4adf-bff0-8abe9ea7e71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.780210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfe7b4-65ce-4adf-bff0-8abe9ea7e71f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.785901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:44.808483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:44.889435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1242/2493] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:44 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:44.894202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a3d0a-5e14-471e-8068-22add143b4d3 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.912384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1252/2494] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:44 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:44.916219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfe7b4-65ce-4adf-bff0-8abe9ea7e71f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:44.925606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfe7b4-65ce-4adf-bff0-8abe9ea7e71f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.961230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a3d0a-5e14-471e-8068-22add143b4d3 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:44.966055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1758-27d4-42b2-9f98-b59878146eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.966689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1758-27d4-42b2-9f98-b59878146eab admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.966961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1758-27d4-42b2-9f98-b59878146eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.967233 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e1758-27d4-42b2-9f98-b59878146eab admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.967854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1758-27d4-42b2-9f98-b59878146eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.970502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e1758-27d4-42b2-9f98-b59878146eab admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:44.985623 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d4cf-6210-41a0-9c01-f9e7959ce029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:44.986414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d4cf-6210-41a0-9c01-f9e7959ce029 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:44.986693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d4cf-6210-41a0-9c01-f9e7959ce029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:44.986962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d4cf-6210-41a0-9c01-f9e7959ce029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:44.987657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414d4cf-6210-41a0-9c01-f9e7959ce029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:44.989214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414d4cf-6210-41a0-9c01-f9e7959ce029 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.000717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1253/2495] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:45.004710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d4cf-6210-41a0-9c01-f9e7959ce029 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.016978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d4cf-6210-41a0-9c01-f9e7959ce029 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.019120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3f74e-f35c-46b3-a5fe-35cdc7d04b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.019691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3f74e-f35c-46b3-a5fe-35cdc7d04b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.019968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3f74e-f35c-46b3-a5fe-35cdc7d04b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.020524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3f74e-f35c-46b3-a5fe-35cdc7d04b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.021147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3f74e-f35c-46b3-a5fe-35cdc7d04b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.022673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3f74e-f35c-46b3-a5fe-35cdc7d04b98 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.033109 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1254/2496] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:45.037093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3f74e-f35c-46b3-a5fe-35cdc7d04b98 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.046762 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3f74e-f35c-46b3-a5fe-35cdc7d04b98 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.051680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f2e99-e606-4ee0-a8e3-3b97f46ba56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.052389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2e99-e606-4ee0-a8e3-3b97f46ba56c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.052675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2e99-e606-4ee0-a8e3-3b97f46ba56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.052953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f2e99-e606-4ee0-a8e3-3b97f46ba56c admin admin] PATH_INFO: `/v3/projects/4530064f82eb4980b34e9ca080d521b5/users/871632d89b5d426fb40f41d4e4b44031/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.070736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f2e99-e606-4ee0-a8e3-3b97f46ba56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4530064f82eb4980b34e9ca080d521b5, user_id=871632d89b5d426fb40f41d4e4b44031, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.073524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f2e99-e606-4ee0-a8e3-3b97f46ba56c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.100891 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1243/2497] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:44 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:45.104967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1758-27d4-42b2-9f98-b59878146eab admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.114661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e1758-27d4-42b2-9f98-b59878146eab admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.119615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a405c-7473-438d-a4d1-8e83bca2ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.121002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a405c-7473-438d-a4d1-8e83bca2ce03 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.121002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a405c-7473-438d-a4d1-8e83bca2ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.121002 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a405c-7473-438d-a4d1-8e83bca2ce03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.121499 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a405c-7473-438d-a4d1-8e83bca2ce03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.123078 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a405c-7473-438d-a4d1-8e83bca2ce03 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.133396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1244/2498] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:45.137577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a405c-7473-438d-a4d1-8e83bca2ce03 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.147630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1255/2499] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:45 2022] PUT /identity/v3/projects/4530064f82eb4980b34e9ca080d521b5/users/871632d89b5d426fb40f41d4e4b44031/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:45.148106 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a405c-7473-438d-a4d1-8e83bca2ce03 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.159077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94fea2-3249-491d-9c18-f1e00ae810ca None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.159368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94fea2-3249-491d-9c18-f1e00ae810ca None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.159641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94fea2-3249-491d-9c18-f1e00ae810ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.187590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-af94fea2-3249-491d-9c18-f1e00ae810ca None None] MFA Rules not processed for user `871632d89b5d426fb40f41d4e4b44031`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:45.189715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-af94fea2-3249-491d-9c18-f1e00ae810ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:45.206730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757380-40e9-4edd-9f93-8ea5030891e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.207384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757380-40e9-4edd-9f93-8ea5030891e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.207660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757380-40e9-4edd-9f93-8ea5030891e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.207932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757380-40e9-4edd-9f93-8ea5030891e1 admin admin] PATH_INFO: `/v3/projects/16c9e483cde348cea4d3b4d3ca8b8dc1/users/71a21c153019480e800c7793ced70dd8/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.224983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757380-40e9-4edd-9f93-8ea5030891e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c9e483cde348cea4d3b4d3ca8b8dc1, user_id=71a21c153019480e800c7793ced70dd8, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.225161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757380-40e9-4edd-9f93-8ea5030891e1 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.254252 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:45.257711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1256/2500] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:45.262362 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94fea2-3249-491d-9c18-f1e00ae810ca None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.273264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94fea2-3249-491d-9c18-f1e00ae810ca None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.277704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc3dc1-952c-4088-84b0-493b94c19a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.278311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3dc1-952c-4088-84b0-493b94c19a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.278592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3dc1-952c-4088-84b0-493b94c19a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.279062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3dc1-952c-4088-84b0-493b94c19a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.279752 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc3dc1-952c-4088-84b0-493b94c19a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.281936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc3dc1-952c-4088-84b0-493b94c19a76 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.312615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1245/2501] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:45 2022] PUT /identity/v3/projects/16c9e483cde348cea4d3b4d3ca8b8dc1/users/71a21c153019480e800c7793ced70dd8/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:45.317276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757380-40e9-4edd-9f93-8ea5030891e1 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.349785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:45.379685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757380-40e9-4edd-9f93-8ea5030891e1 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.391237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1257/2502] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:45 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:45.392685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bcb52-985f-4a76-9cf0-3178ad410848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.393344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bcb52-985f-4a76-9cf0-3178ad410848 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.393620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bcb52-985f-4a76-9cf0-3178ad410848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.393912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bcb52-985f-4a76-9cf0-3178ad410848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.394562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bcb52-985f-4a76-9cf0-3178ad410848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.394979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc3dc1-952c-4088-84b0-493b94c19a76 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.396458 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bcb52-985f-4a76-9cf0-3178ad410848 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.406646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1246/2503] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:45.416292 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bcb52-985f-4a76-9cf0-3178ad410848 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.429304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bcb52-985f-4a76-9cf0-3178ad410848 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.460224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc3dc1-952c-4088-84b0-493b94c19a76 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.466527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d03e-1b11-4144-bdab-a69cf35c4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.467217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d03e-1b11-4144-bdab-a69cf35c4314 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.467640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d03e-1b11-4144-bdab-a69cf35c4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.470702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d03e-1b11-4144-bdab-a69cf35c4314 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.470702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638d03e-1b11-4144-bdab-a69cf35c4314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.471577 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638d03e-1b11-4144-bdab-a69cf35c4314 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.489064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c1332-0f81-4189-8fd4-70b76194bbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.489726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1332-0f81-4189-8fd4-70b76194bbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.490004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1332-0f81-4189-8fd4-70b76194bbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.490359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c1332-0f81-4189-8fd4-70b76194bbaa admin admin] PATH_INFO: `/v3/projects/16c9e483cde348cea4d3b4d3ca8b8dc1/users/71a21c153019480e800c7793ced70dd8/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.492224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c1332-0f81-4189-8fd4-70b76194bbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c9e483cde348cea4d3b4d3ca8b8dc1, user_id=71a21c153019480e800c7793ced70dd8, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.494925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c1332-0f81-4189-8fd4-70b76194bbaa admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.507321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1247/2504] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:45 2022] PUT /identity/v3/projects/16c9e483cde348cea4d3b4d3ca8b8dc1/users/71a21c153019480e800c7793ced70dd8/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:45.518147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd9955-1153-4d8e-aaf0-e31ff1053bc8 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.518496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd9955-1153-4d8e-aaf0-e31ff1053bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.518910 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd9955-1153-4d8e-aaf0-e31ff1053bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.546368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-95bd9955-1153-4d8e-aaf0-e31ff1053bc8 None None] MFA Rules not processed for user `71a21c153019480e800c7793ced70dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:45.547540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-95bd9955-1153-4d8e-aaf0-e31ff1053bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:45.558465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1258/2505] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:45 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:45.564465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d03e-1b11-4144-bdab-a69cf35c4314 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.573304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d03e-1b11-4144-bdab-a69cf35c4314 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.619500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1248/2506] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:45.632154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd9955-1153-4d8e-aaf0-e31ff1053bc8 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.638932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4198d-14a6-4dc9-8c0c-0067acf6d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.639672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4198d-14a6-4dc9-8c0c-0067acf6d44c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.640080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4198d-14a6-4dc9-8c0c-0067acf6d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.640650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4198d-14a6-4dc9-8c0c-0067acf6d44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.641465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4198d-14a6-4dc9-8c0c-0067acf6d44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.643968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4198d-14a6-4dc9-8c0c-0067acf6d44c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.654096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1259/2507] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:45.658466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4198d-14a6-4dc9-8c0c-0067acf6d44c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.668400 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4198d-14a6-4dc9-8c0c-0067acf6d44c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.675039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60e517-aae2-4744-8d8c-c982e076e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.675646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60e517-aae2-4744-8d8c-c982e076e2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.675926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60e517-aae2-4744-8d8c-c982e076e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.676201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60e517-aae2-4744-8d8c-c982e076e2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.676886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60e517-aae2-4744-8d8c-c982e076e2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.678467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60e517-aae2-4744-8d8c-c982e076e2c1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.691137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1260/2508] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:45.696523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:45.699300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60e517-aae2-4744-8d8c-c982e076e2c1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.701145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd9955-1153-4d8e-aaf0-e31ff1053bc8 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.705374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27093-fb01-4674-a788-b8f272af2a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.705981 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27093-fb01-4674-a788-b8f272af2a1b service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.706258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27093-fb01-4674-a788-b8f272af2a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.706528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27093-fb01-4674-a788-b8f272af2a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.709822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60e517-aae2-4744-8d8c-c982e076e2c1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.714521 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479711f-673a-4a0b-9339-56c4ff020e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.715184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479711f-673a-4a0b-9339-56c4ff020e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.715641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479711f-673a-4a0b-9339-56c4ff020e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.715863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479711f-673a-4a0b-9339-56c4ff020e7b admin admin] PATH_INFO: `/v3/projects/75317f64888c4837b5f4a6edaa7dbe60/users/3c0bfcc9c53749c6b7ba8f387167df03/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.716263 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca27093-fb01-4674-a788-b8f272af2a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.717923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca27093-fb01-4674-a788-b8f272af2a1b service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.728578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1249/2509] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:45.730894 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479711f-673a-4a0b-9339-56c4ff020e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75317f64888c4837b5f4a6edaa7dbe60, user_id=3c0bfcc9c53749c6b7ba8f387167df03, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.733597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479711f-673a-4a0b-9339-56c4ff020e7b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:45.799518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1261/2510] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:45 2022] PUT /identity/v3/projects/75317f64888c4837b5f4a6edaa7dbe60/users/3c0bfcc9c53749c6b7ba8f387167df03/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:45.809710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95645d44-ce26-44ea-b574-55b162f07fa3 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.810030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95645d44-ce26-44ea-b574-55b162f07fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.810256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95645d44-ce26-44ea-b574-55b162f07fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.844939 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-95645d44-ce26-44ea-b574-55b162f07fa3 None None] MFA Rules not processed for user `3c0bfcc9c53749c6b7ba8f387167df03`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:45.846230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-95645d44-ce26-44ea-b574-55b162f07fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:45.911100 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1250/2511] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:45.915557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479711f-673a-4a0b-9339-56c4ff020e7b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.947811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:45.966990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95645d44-ce26-44ea-b574-55b162f07fa3 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:45.980793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479711f-673a-4a0b-9339-56c4ff020e7b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:45.985943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873480c-828d-4ac5-8336-6f839a383857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:45.986508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873480c-828d-4ac5-8336-6f839a383857 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:45.986820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873480c-828d-4ac5-8336-6f839a383857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:45.987096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873480c-828d-4ac5-8336-6f839a383857 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:45.988025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873480c-828d-4ac5-8336-6f839a383857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:45.990183 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873480c-828d-4ac5-8336-6f839a383857 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.021938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95645d44-ce26-44ea-b574-55b162f07fa3 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:46.025505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a259731-b0a3-404e-953e-dc0039c5a225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:46.026107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259731-b0a3-404e-953e-dc0039c5a225 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.026386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259731-b0a3-404e-953e-dc0039c5a225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.026658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a259731-b0a3-404e-953e-dc0039c5a225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.068384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1262/2512] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:45 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:46.072667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873480c-828d-4ac5-8336-6f839a383857 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:46.082035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a259731-b0a3-404e-953e-dc0039c5a225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:46.083659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a259731-b0a3-404e-953e-dc0039c5a225 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.093258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1251/2513] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:46.138011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873480c-828d-4ac5-8336-6f839a383857 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:46.143497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219521da-6c54-421c-8b8f-0658e9e3f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:46.144499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219521da-6c54-421c-8b8f-0658e9e3f7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.144958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219521da-6c54-421c-8b8f-0658e9e3f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.145668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219521da-6c54-421c-8b8f-0658e9e3f7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.146697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219521da-6c54-421c-8b8f-0658e9e3f7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:46.150217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219521da-6c54-421c-8b8f-0658e9e3f7b6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.232135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1263/2514] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:46 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:46.237312 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a259731-b0a3-404e-953e-dc0039c5a225 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:46.247975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a259731-b0a3-404e-953e-dc0039c5a225 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:46.252782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62cd8e-8900-4682-a557-f47fd813c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:46.253370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62cd8e-8900-4682-a557-f47fd813c7fa admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.253642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62cd8e-8900-4682-a557-f47fd813c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.253950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62cd8e-8900-4682-a557-f47fd813c7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.254662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62cd8e-8900-4682-a557-f47fd813c7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:46.256328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62cd8e-8900-4682-a557-f47fd813c7fa admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.266168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1252/2515] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:46.270635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219521da-6c54-421c-8b8f-0658e9e3f7b6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:46.280549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219521da-6c54-421c-8b8f-0658e9e3f7b6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:46.285823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e867-e16d-4036-bb54-c6e32898fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:46.286467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e867-e16d-4036-bb54-c6e32898fd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.286745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e867-e16d-4036-bb54-c6e32898fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.287044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74e867-e16d-4036-bb54-c6e32898fd22 admin admin] PATH_INFO: `/v3/projects/a3761d7ceea147d286b41f074614cc66/users/a8f344d5956149ebabe7bbd625c39173/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.302765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74e867-e16d-4036-bb54-c6e32898fd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3761d7ceea147d286b41f074614cc66, user_id=a8f344d5956149ebabe7bbd625c39173, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:46.305554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74e867-e16d-4036-bb54-c6e32898fd22 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.375203 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1264/2516] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:46 2022] PUT /identity/v3/projects/a3761d7ceea147d286b41f074614cc66/users/a8f344d5956149ebabe7bbd625c39173/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:46.379351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62cd8e-8900-4682-a557-f47fd813c7fa admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:46.389418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62cd8e-8900-4682-a557-f47fd813c7fa admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:46.408780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:46.446780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8a70-30b6-4305-829d-bca5a50219d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:46.455829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8a70-30b6-4305-829d-bca5a50219d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.455829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8a70-30b6-4305-829d-bca5a50219d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.455829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8a70-30b6-4305-829d-bca5a50219d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.455829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8a70-30b6-4305-829d-bca5a50219d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:46.455829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8a70-30b6-4305-829d-bca5a50219d2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.462373 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1253/2517] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:46.466835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e867-e16d-4036-bb54-c6e32898fd22 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:46.478989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74e867-e16d-4036-bb54-c6e32898fd22 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:46.484408 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:46.485551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.485835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.486330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] PATH_INFO: `/v3/projects/a3761d7ceea147d286b41f074614cc66/users/a8f344d5956149ebabe7bbd625c39173/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.488789 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3761d7ceea147d286b41f074614cc66, user_id=a8f344d5956149ebabe7bbd625c39173, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:46.491581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.503500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1265/2518] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:46 2022] PUT /identity/v3/projects/a3761d7ceea147d286b41f074614cc66/users/a8f344d5956149ebabe7bbd625c39173/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:46.514765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ac4c-5787-4a53-a0b3-2adaac0a9f89 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.515047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ac4c-5787-4a53-a0b3-2adaac0a9f89 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.515334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7ac4c-5787-4a53-a0b3-2adaac0a9f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.544884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-29c7ac4c-5787-4a53-a0b3-2adaac0a9f89 None None] MFA Rules not processed for user `a8f344d5956149ebabe7bbd625c39173`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:46.546095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-29c7ac4c-5787-4a53-a0b3-2adaac0a9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:46.615037 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1254/2519] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:46.625750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:46.627553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:46.690139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780129b2-2ebf-4bde-afbd-a41271bb9416 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:46.696075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab076ee9-f7ef-4666-95a7-64422c6e648f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:46.696075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab076ee9-f7ef-4666-95a7-64422c6e648f service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.696075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab076ee9-f7ef-4666-95a7-64422c6e648f service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.696075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab076ee9-f7ef-4666-95a7-64422c6e648f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.704837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab076ee9-f7ef-4666-95a7-64422c6e648f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:46.710818 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab076ee9-f7ef-4666-95a7-64422c6e648f service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.715748 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7ac4c-5787-4a53-a0b3-2adaac0a9f89 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:46.722845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1266/2520] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:46.727694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7ac4c-5787-4a53-a0b3-2adaac0a9f89 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:46.731699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:46.732428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:46.732796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:46.733138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:46.734929 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:46.801203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:46.802664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:46.812130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1255/2521] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:48.142177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab076ee9-f7ef-4666-95a7-64422c6e648f service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:48.151095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab076ee9-f7ef-4666-95a7-64422c6e648f service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:48.154688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a2ea1-16d0-4d4a-b868-d676b7174b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:48.155318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2ea1-16d0-4d4a-b868-d676b7174b48 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:48.155593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2ea1-16d0-4d4a-b868-d676b7174b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:48.155861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2ea1-16d0-4d4a-b868-d676b7174b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:48.161443 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:48.213946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a2ea1-16d0-4d4a-b868-d676b7174b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:48.215383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a2ea1-16d0-4d4a-b868-d676b7174b48 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:48.225030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1267/2522] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:48.628413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:48.637179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0c78-43cd-4dd4-99a6-59b26400ba90 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:48.641017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d17e8-b159-4fdb-a1fa-58480f03ceac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:48.642202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d17e8-b159-4fdb-a1fa-58480f03ceac service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:48.643174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d17e8-b159-4fdb-a1fa-58480f03ceac service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:48.643174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d17e8-b159-4fdb-a1fa-58480f03ceac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:48.683720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:48.702465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d17e8-b159-4fdb-a1fa-58480f03ceac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:48.704644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d17e8-b159-4fdb-a1fa-58480f03ceac service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:48.714302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1256/2523] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:50.585751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a2ea1-16d0-4d4a-b868-d676b7174b48 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:50.650978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a2ea1-16d0-4d4a-b868-d676b7174b48 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:50.655523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:50.656150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:50.656456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:50.656733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] PATH_INFO: `/v3/users/9f2541af2656418e82f89271b77754d3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:50.657862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2541af2656418e82f89271b77754d3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:50.659764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:50.891854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2541af2656418e82f89271b77754d3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:50.892544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2541af2656418e82f89271b77754d3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:50.969122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2541af2656418e82f89271b77754d3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:50.976614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2541af2656418e82f89271b77754d3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:50.989279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2541af2656418e82f89271b77754d3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:50.995149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1268/2524] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:50 2022] DELETE /identity/v3/users/9f2541af2656418e82f89271b77754d3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:50.999776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f78b33-5c27-4c4c-8d11-cbd138617353 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:51.000286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f78b33-5c27-4c4c-8d11-cbd138617353 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:51.000433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f78b33-5c27-4c4c-8d11-cbd138617353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:51.019750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-47f78b33-5c27-4c4c-8d11-cbd138617353 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:51.021217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-47f78b33-5c27-4c4c-8d11-cbd138617353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:51.080035 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1257/2525] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:51.089678 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:51.091063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:51.121515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:51.147552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10979b-67f6-48af-b401-1f9028783d5b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:51.151132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d606-919a-4116-acc5-8f6061158478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:51.151730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d606-919a-4116-acc5-8f6061158478 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:51.152009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d606-919a-4116-acc5-8f6061158478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:51.152283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d606-919a-4116-acc5-8f6061158478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:51.161039 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d606-919a-4116-acc5-8f6061158478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:51.162500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d606-919a-4116-acc5-8f6061158478 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:51.172224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1269/2526] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:51.631815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f78b33-5c27-4c4c-8d11-cbd138617353 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:51.633280 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-47f78b33-5c27-4c4c-8d11-cbd138617353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:51.646508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f78b33-5c27-4c4c-8d11-cbd138617353 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:51.653481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:51.658214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:51.658214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:51.658214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] PATH_INFO: `/v3/projects/9d8e911bcf254dfaba1c8e26066dd281` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:51.658214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8e911bcf254dfaba1c8e26066dd281)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:51.659004 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:51.782800 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8e911bcf254dfaba1c8e26066dd281', 'request_id': 'req-d08de728-606f-4fb2-82e8-613b06ffadb3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:51.788905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8e911bcf254dfaba1c8e26066dd281', 'request_id': 'req-d08de728-606f-4fb2-82e8-613b06ffadb3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:51.794656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8e911bcf254dfaba1c8e26066dd281', 'request_id': 'req-d08de728-606f-4fb2-82e8-613b06ffadb3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:51.884502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] The token cache is being invalidate because project 9d8e911bcf254dfaba1c8e26066dd281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:51.894179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:51.894179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:51.894179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1258/2527] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:51 2022] DELETE /identity/v3/projects/9d8e911bcf254dfaba1c8e26066dd281 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:51.897592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d606-919a-4116-acc5-8f6061158478 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:51.915091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d606-919a-4116-acc5-8f6061158478 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:51.977907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:51.978575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:51.978854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:51.979126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] PATH_INFO: `/v3/users/71a21c153019480e800c7793ced70dd8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:51.980383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a21c153019480e800c7793ced70dd8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:51.982330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:52.223640 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a21c153019480e800c7793ced70dd8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:52.224297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a21c153019480e800c7793ced70dd8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:52.289208 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a21c153019480e800c7793ced70dd8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:52.296430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a21c153019480e800c7793ced70dd8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:52.309090 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40e4d6d4-e252-484e-b573-8eb5a914e41d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a21c153019480e800c7793ced70dd8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:52.315960 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1270/2528] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:51 2022] DELETE /identity/v3/users/71a21c153019480e800c7793ced70dd8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:52.754718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:52.756244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:52.771588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08de728-606f-4fb2-82e8-613b06ffadb3 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:52.833988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:52.834625 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:52.834901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:52.835173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] PATH_INFO: `/v3/projects/16c9e483cde348cea4d3b4d3ca8b8dc1` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:52.836338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c9e483cde348cea4d3b4d3ca8b8dc1)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:52.838300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:52.843697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:52.995222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c9e483cde348cea4d3b4d3ca8b8dc1', 'request_id': 'req-4d844822-387c-4e6b-b5b0-b334686ee425'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.002506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c9e483cde348cea4d3b4d3ca8b8dc1', 'request_id': 'req-4d844822-387c-4e6b-b5b0-b334686ee425'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.008250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c9e483cde348cea4d3b4d3ca8b8dc1', 'request_id': 'req-4d844822-387c-4e6b-b5b0-b334686ee425'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.089429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] The token cache is being invalidate because project 16c9e483cde348cea4d3b4d3ca8b8dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:53.089725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.090358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4d844822-387c-4e6b-b5b0-b334686ee425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.091887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1259/2529] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:52 2022] DELETE /identity/v3/projects/16c9e483cde348cea4d3b4d3ca8b8dc1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:53.096839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512f6e4-12a2-43e7-8baf-e9460c0ce0f5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.097328 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512f6e4-12a2-43e7-8baf-e9460c0ce0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.097449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512f6e4-12a2-43e7-8baf-e9460c0ce0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.120010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3512f6e4-12a2-43e7-8baf-e9460c0ce0f5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:53.121321 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3512f6e4-12a2-43e7-8baf-e9460c0ce0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:53.164932 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:53.180262 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1271/2530] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:53.190020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbd80d-e86c-42e2-8ad4-8b50a15a655c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.190349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbd80d-e86c-42e2-8ad4-8b50a15a655c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.190633 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbd80d-e86c-42e2-8ad4-8b50a15a655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.207276 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512f6e4-12a2-43e7-8baf-e9460c0ce0f5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.208679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3512f6e4-12a2-43e7-8baf-e9460c0ce0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:53.211966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-6fcbd80d-e86c-42e2-8ad4-8b50a15a655c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:53.213113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6fcbd80d-e86c-42e2-8ad4-8b50a15a655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:53.221723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1260/2531] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:53.225639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbd80d-e86c-42e2-8ad4-8b50a15a655c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.235742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbd80d-e86c-42e2-8ad4-8b50a15a655c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:53.240479 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:53.241063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.241337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.241606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.242296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:53.242605 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:53.244358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:53.260237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1261/2532] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:29:53.261341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.269325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512f6e4-12a2-43e7-8baf-e9460c0ce0f5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:53.271245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7ad28-81ed-4185-84b1-1bafe0363539 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:53.274015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:53.274691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.275037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.275420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.275771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:53.276400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.276678 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.276946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.277554 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:53.277687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:53.279431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:53.336330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:53.337790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:53.347157 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1272/2533] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:53.380768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1262/2534] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:53 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:53.382657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.392910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c51da-1e76-42bb-b15d-f1988e96074d service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:53.459809 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08715e-4c78-46c6-bc33-c83261740838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:53.460457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08715e-4c78-46c6-bc33-c83261740838 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.460743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08715e-4c78-46c6-bc33-c83261740838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.461020 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08715e-4c78-46c6-bc33-c83261740838 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.461663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08715e-4c78-46c6-bc33-c83261740838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:53.463624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08715e-4c78-46c6-bc33-c83261740838 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:53.498215 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.499940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:53.512767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a8e4f-48c9-4baa-8df4-859efcad4862 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:53.517606 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:53.520720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.520720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.520720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] PATH_INFO: `/v3/users/11b3416a31b44fb5a08e3f0aaf4e30ce` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.520720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b3416a31b44fb5a08e3f0aaf4e30ce)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:53.522151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:53.547297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1273/2535] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:53 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:53.552171 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08715e-4c78-46c6-bc33-c83261740838 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.561819 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08715e-4c78-46c6-bc33-c83261740838 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:53.566523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd9338-b440-451b-8ef4-83ffa59fe7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:53.567105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd9338-b440-451b-8ef4-83ffa59fe7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.567382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd9338-b440-451b-8ef4-83ffa59fe7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.567649 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd9338-b440-451b-8ef4-83ffa59fe7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.568284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd9338-b440-451b-8ef4-83ffa59fe7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:53.569884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd9338-b440-451b-8ef4-83ffa59fe7fc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:53.579404 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1274/2536] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:53.587446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd9338-b440-451b-8ef4-83ffa59fe7fc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.604552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd9338-b440-451b-8ef4-83ffa59fe7fc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:53.609013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50522aae-41a6-4336-8b0f-94873142c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:53.609589 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522aae-41a6-4336-8b0f-94873142c4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.609957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522aae-41a6-4336-8b0f-94873142c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.610694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50522aae-41a6-4336-8b0f-94873142c4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.611313 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50522aae-41a6-4336-8b0f-94873142c4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:53.612913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50522aae-41a6-4336-8b0f-94873142c4b0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:53.622943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1275/2537] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:53.626886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50522aae-41a6-4336-8b0f-94873142c4b0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.636158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50522aae-41a6-4336-8b0f-94873142c4b0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:53.640935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc959c4-e9f4-4eac-93bd-2e0295a55600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:53.646433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc959c4-e9f4-4eac-93bd-2e0295a55600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.646433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc959c4-e9f4-4eac-93bd-2e0295a55600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.646433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc959c4-e9f4-4eac-93bd-2e0295a55600 admin admin] PATH_INFO: `/v3/projects/a3d6fab12806468786dcd38ae90c3dff/users/b3fc246dc14d4a17ae1d8c731fd68444/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.650377 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:53.658376 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc959c4-e9f4-4eac-93bd-2e0295a55600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d6fab12806468786dcd38ae90c3dff, user_id=b3fc246dc14d4a17ae1d8c731fd68444, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:53.661077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc959c4-e9f4-4eac-93bd-2e0295a55600 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:53.739016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b3416a31b44fb5a08e3f0aaf4e30ce'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.793137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1276/2538] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:53 2022] PUT /identity/v3/projects/a3d6fab12806468786dcd38ae90c3dff/users/b3fc246dc14d4a17ae1d8c731fd68444/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:53.805474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28616a-e893-4ee4-8d48-971a9443bff8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.805860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28616a-e893-4ee4-8d48-971a9443bff8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.806061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28616a-e893-4ee4-8d48-971a9443bff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.815315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b3416a31b44fb5a08e3f0aaf4e30ce'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.818452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b3416a31b44fb5a08e3f0aaf4e30ce'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.834717 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b3416a31b44fb5a08e3f0aaf4e30ce'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.835600 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-85708504-dec3-44f7-8920-30429c0da9a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b3416a31b44fb5a08e3f0aaf4e30ce'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:53.849218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6b28616a-e893-4ee4-8d48-971a9443bff8 None None] MFA Rules not processed for user `b3fc246dc14d4a17ae1d8c731fd68444`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:53.856383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6b28616a-e893-4ee4-8d48-971a9443bff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:53.872406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1263/2539] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:53 2022] DELETE /identity/v3/users/11b3416a31b44fb5a08e3f0aaf4e30ce => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:53.877775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1b5ed-115d-4837-90cf-92271c4bfc60 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:53.882870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1b5ed-115d-4837-90cf-92271c4bfc60 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:53.882870 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1b5ed-115d-4837-90cf-92271c4bfc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:53.903704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-22d1b5ed-115d-4837-90cf-92271c4bfc60 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:53.905082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-22d1b5ed-115d-4837-90cf-92271c4bfc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:53.921878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:53.940179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1277/2540] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:53.945974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28616a-e893-4ee4-8d48-971a9443bff8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.947371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6b28616a-e893-4ee4-8d48-971a9443bff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:53.979438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1264/2541] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:53.989644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1b5ed-115d-4837-90cf-92271c4bfc60 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:53.991428 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-22d1b5ed-115d-4837-90cf-92271c4bfc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:54.018411 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28616a-e893-4ee4-8d48-971a9443bff8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.023435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c063f4-f645-4255-b10b-858417537d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.024044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c063f4-f645-4255-b10b-858417537d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.024339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c063f4-f645-4255-b10b-858417537d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.024621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c063f4-f645-4255-b10b-858417537d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.025246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c063f4-f645-4255-b10b-858417537d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.027199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c063f4-f645-4255-b10b-858417537d5e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.054621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1b5ed-115d-4837-90cf-92271c4bfc60 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.059007 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c234e7-75e5-49f2-b4f5-7b64bdd77022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.059705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c234e7-75e5-49f2-b4f5-7b64bdd77022 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.059986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c234e7-75e5-49f2-b4f5-7b64bdd77022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.068732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c234e7-75e5-49f2-b4f5-7b64bdd77022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.069644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c234e7-75e5-49f2-b4f5-7b64bdd77022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.071063 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c234e7-75e5-49f2-b4f5-7b64bdd77022 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.080902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1265/2542] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:54.126410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1278/2543] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:53 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:29:54.130700 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c234e7-75e5-49f2-b4f5-7b64bdd77022 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:54.140260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c234e7-75e5-49f2-b4f5-7b64bdd77022 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.197313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f54a3-cd00-432d-8acc-2f2b7536c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.197916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f54a3-cd00-432d-8acc-2f2b7536c864 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.198191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f54a3-cd00-432d-8acc-2f2b7536c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.198460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f54a3-cd00-432d-8acc-2f2b7536c864 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.199104 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f54a3-cd00-432d-8acc-2f2b7536c864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.201033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f54a3-cd00-432d-8acc-2f2b7536c864 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.333318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1266/2544] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:54 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:54.334603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c063f4-f645-4255-b10b-858417537d5e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:54.345145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c063f4-f645-4255-b10b-858417537d5e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.351810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372bb0-40b0-478a-b58c-208fddcb2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.358725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372bb0-40b0-478a-b58c-208fddcb2556 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.358725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372bb0-40b0-478a-b58c-208fddcb2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.358725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372bb0-40b0-478a-b58c-208fddcb2556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.358725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4372bb0-40b0-478a-b58c-208fddcb2556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.358725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4372bb0-40b0-478a-b58c-208fddcb2556 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.367471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1279/2545] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:54.371734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f54a3-cd00-432d-8acc-2f2b7536c864 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:54.383111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f54a3-cd00-432d-8acc-2f2b7536c864 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.388419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c6db2-1418-45a3-bf6b-80af9b120613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.389158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c6db2-1418-45a3-bf6b-80af9b120613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.389538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c6db2-1418-45a3-bf6b-80af9b120613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.389907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c6db2-1418-45a3-bf6b-80af9b120613 admin admin] PATH_INFO: `/v3/projects/676c92ddd6ac4f5ebd165601c4d7b752/users/5c7f6ba460654bd995f15aa19c3a58cf/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.407384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c6db2-1418-45a3-bf6b-80af9b120613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676c92ddd6ac4f5ebd165601c4d7b752, user_id=5c7f6ba460654bd995f15aa19c3a58cf, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.410483 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c6db2-1418-45a3-bf6b-80af9b120613 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.502070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1267/2546] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:54 2022] PUT /identity/v3/projects/676c92ddd6ac4f5ebd165601c4d7b752/users/5c7f6ba460654bd995f15aa19c3a58cf/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:54.506311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372bb0-40b0-478a-b58c-208fddcb2556 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:54.517016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372bb0-40b0-478a-b58c-208fddcb2556 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.573061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:54.582620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.583228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.583504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.583774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.584449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.586021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.597155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1280/2547] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:54.600879 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c6db2-1418-45a3-bf6b-80af9b120613 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:54.608532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:54.612217 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:54.614668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c6db2-1418-45a3-bf6b-80af9b120613 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.620744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48c7ff-2e62-4cb9-972c-3837ffda3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.621568 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48c7ff-2e62-4cb9-972c-3837ffda3e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.621948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48c7ff-2e62-4cb9-972c-3837ffda3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.622353 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48c7ff-2e62-4cb9-972c-3837ffda3e92 admin admin] PATH_INFO: `/v3/projects/676c92ddd6ac4f5ebd165601c4d7b752/users/5c7f6ba460654bd995f15aa19c3a58cf/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.624687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48c7ff-2e62-4cb9-972c-3837ffda3e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676c92ddd6ac4f5ebd165601c4d7b752, user_id=5c7f6ba460654bd995f15aa19c3a58cf, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.626155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26749b-72e6-4627-a055-1631d59baf87 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.629856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48c7ff-2e62-4cb9-972c-3837ffda3e92 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.631581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.632426 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.634858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.634858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] PATH_INFO: `/v3/projects/244ee38ce9f1416f8a187bf2e97b77f8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.635352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=244ee38ce9f1416f8a187bf2e97b77f8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.636989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.643557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1268/2548] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:54 2022] PUT /identity/v3/projects/676c92ddd6ac4f5ebd165601c4d7b752/users/5c7f6ba460654bd995f15aa19c3a58cf/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:54.654829 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052094d1-360a-4b5f-9887-6f2275f9b029 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.655113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052094d1-360a-4b5f-9887-6f2275f9b029 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.655382 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052094d1-360a-4b5f-9887-6f2275f9b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.683257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-052094d1-360a-4b5f-9887-6f2275f9b029 None None] MFA Rules not processed for user `5c7f6ba460654bd995f15aa19c3a58cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:54.684490 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-052094d1-360a-4b5f-9887-6f2275f9b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:54.689287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:54.754447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1269/2549] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:54.765480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052094d1-360a-4b5f-9887-6f2275f9b029 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:54.767183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-052094d1-360a-4b5f-9887-6f2275f9b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:54.781668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244ee38ce9f1416f8a187bf2e97b77f8', 'request_id': 'req-840d9b2d-8eed-4304-9b9b-6fc389539dfa'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:54.787575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244ee38ce9f1416f8a187bf2e97b77f8', 'request_id': 'req-840d9b2d-8eed-4304-9b9b-6fc389539dfa'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:54.795103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244ee38ce9f1416f8a187bf2e97b77f8', 'request_id': 'req-840d9b2d-8eed-4304-9b9b-6fc389539dfa'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:54.827793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052094d1-360a-4b5f-9887-6f2275f9b029 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.880291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bbc83-cc2b-4adb-847b-c1e00a482913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.880925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bbc83-cc2b-4adb-847b-c1e00a482913 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.881199 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bbc83-cc2b-4adb-847b-c1e00a482913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.881465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bbc83-cc2b-4adb-847b-c1e00a482913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:54.900749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] The token cache is being invalidate because project 244ee38ce9f1416f8a187bf2e97b77f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:54.901088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:54.901807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:54.903325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1281/2550] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:54 2022] DELETE /identity/v3/projects/244ee38ce9f1416f8a187bf2e97b77f8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:54.914583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:54.916049 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:54.955349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bbc83-cc2b-4adb-847b-c1e00a482913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:54.956997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bbc83-cc2b-4adb-847b-c1e00a482913 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:54.967307 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1270/2551] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:54.998555 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d9b2d-8eed-4304-9b9b-6fc389539dfa admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:54.998695 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:54.999345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:54.999599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:54.999871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] PATH_INFO: `/v3/users/2ea0591e430940b985795469c3f62c59` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:55.001059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea0591e430940b985795469c3f62c59)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:55.003550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:55.234787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea0591e430940b985795469c3f62c59'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:55.234787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea0591e430940b985795469c3f62c59'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:55.284302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea0591e430940b985795469c3f62c59'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:55.294333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea0591e430940b985795469c3f62c59'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:55.299806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:55.305191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea0591e430940b985795469c3f62c59'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:55.311120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1282/2552] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:54 2022] DELETE /identity/v3/users/2ea0591e430940b985795469c3f62c59 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:55.765629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bbc83-cc2b-4adb-847b-c1e00a482913 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:55.785272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bbc83-cc2b-4adb-847b-c1e00a482913 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:55.809727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:55.862986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:55.863683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:55.863880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:55.864150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] PATH_INFO: `/v3/projects/36afcc164efc40259e7b706d8803cf67` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:55.865394 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36afcc164efc40259e7b706d8803cf67)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:55.867555 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:56.028463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36afcc164efc40259e7b706d8803cf67', 'request_id': 'req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.035240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36afcc164efc40259e7b706d8803cf67', 'request_id': 'req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.040820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36afcc164efc40259e7b706d8803cf67', 'request_id': 'req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.106208 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] The token cache is being invalidate because project 36afcc164efc40259e7b706d8803cf67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:56.106497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.107151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.108653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1271/2553] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:55 2022] DELETE /identity/v3/projects/36afcc164efc40259e7b706d8803cf67 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:56.113086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:56.114517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:56.127442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def986-ec4f-4b88-812c-827cf6b6edf1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:56.185705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:56.186354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:56.186625 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:56.186899 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] PATH_INFO: `/v3/users/f4daa8a3e1dd49d7ad88a2f87358e694` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:56.188069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4daa8a3e1dd49d7ad88a2f87358e694)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:56.190462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:56.351027 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4daa8a3e1dd49d7ad88a2f87358e694'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.351687 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4daa8a3e1dd49d7ad88a2f87358e694'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.436665 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4daa8a3e1dd49d7ad88a2f87358e694'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.444622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4daa8a3e1dd49d7ad88a2f87358e694'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.457150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4daa8a3e1dd49d7ad88a2f87358e694'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:56.462953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1283/2554] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:56 2022] DELETE /identity/v3/users/f4daa8a3e1dd49d7ad88a2f87358e694 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:56.825903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:56.828840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:56.933621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e26e-47c2-49de-bd02-8d71f78ee7c6 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:57.057731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475fa76-17ee-4ca4-a55d-8bb40eebfafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:57.058682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475fa76-17ee-4ca4-a55d-8bb40eebfafe service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.059288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475fa76-17ee-4ca4-a55d-8bb40eebfafe service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.059620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475fa76-17ee-4ca4-a55d-8bb40eebfafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.061467 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4475fa76-17ee-4ca4-a55d-8bb40eebfafe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:57.073759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:57.121673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:57.123718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:57.195725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475fa76-17ee-4ca4-a55d-8bb40eebfafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:57.197206 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475fa76-17ee-4ca4-a55d-8bb40eebfafe service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:57.208837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1272/2555] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:29:57.214345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23ac1-db04-49a7-970c-b897f34c3c79 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:57.219127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:57.220422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.220780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.221133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] PATH_INFO: `/v3/projects/080d922be7c14bf0baf7c8e83433c71a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.222397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=080d922be7c14bf0baf7c8e83433c71a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:57.224395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:57.237719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:57.353650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080d922be7c14bf0baf7c8e83433c71a', 'request_id': 'req-7a114b5b-34be-4c06-8eb7-dcefed499e8d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:57.359531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080d922be7c14bf0baf7c8e83433c71a', 'request_id': 'req-7a114b5b-34be-4c06-8eb7-dcefed499e8d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:57.367944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080d922be7c14bf0baf7c8e83433c71a', 'request_id': 'req-7a114b5b-34be-4c06-8eb7-dcefed499e8d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:57.432820 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] The token cache is being invalidate because project 080d922be7c14bf0baf7c8e83433c71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:57.433041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:57.433666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7a114b5b-34be-4c06-8eb7-dcefed499e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:57.435144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1284/2556] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:57 2022] DELETE /identity/v3/projects/080d922be7c14bf0baf7c8e83433c71a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:57.440778 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533997e-b402-41de-8b78-d0cc77b2fa25 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.441065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533997e-b402-41de-8b78-d0cc77b2fa25 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.441336 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533997e-b402-41de-8b78-d0cc77b2fa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.461627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8533997e-b402-41de-8b78-d0cc77b2fa25 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:57.462867 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8533997e-b402-41de-8b78-d0cc77b2fa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:57.523579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1273/2557] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:57.531327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a30a2-e70b-429d-86c1-ca616d0216a9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.531610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a30a2-e70b-429d-86c1-ca616d0216a9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.531905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a30a2-e70b-429d-86c1-ca616d0216a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.552973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a34a30a2-e70b-429d-86c1-ca616d0216a9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:57.554224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a34a30a2-e70b-429d-86c1-ca616d0216a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:57.562944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1285/2558] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:57.567745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533997e-b402-41de-8b78-d0cc77b2fa25 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:57.577447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533997e-b402-41de-8b78-d0cc77b2fa25 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:57.582148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:57.582742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.583023 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.583293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.583976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:29:57.584277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:57.586014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:57.597838 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1274/2559] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:29:57.602495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a30a2-e70b-429d-86c1-ca616d0216a9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:57.612769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a30a2-e70b-429d-86c1-ca616d0216a9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:57.618722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:57.621247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.621247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.621247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.621247 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:57.622853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:57.774251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1286/2560] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:29:57 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:57.778610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:57.791478 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d857d5-b649-4c89-8210-56e669ab4fce admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:57.806405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:57.808381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:57.870654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d2e2d-1be5-40d7-9e56-23d694d4fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:57.871364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2e2d-1be5-40d7-9e56-23d694d4fc27 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.871644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2e2d-1be5-40d7-9e56-23d694d4fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.875363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2e2d-1be5-40d7-9e56-23d694d4fc27 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.875363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d2e2d-1be5-40d7-9e56-23d694d4fc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:57.875363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d2e2d-1be5-40d7-9e56-23d694d4fc27 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:57.882919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c62a2-5a15-455c-81cc-a6edc849517e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:57.889103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:57.889785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.890070 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.890387 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] PATH_INFO: `/v3/users/871632d89b5d426fb40f41d4e4b44031` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.892514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=871632d89b5d426fb40f41d4e4b44031)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:57.895040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:57.963461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1275/2561] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:29:57 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:29:57.964116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d2e2d-1be5-40d7-9e56-23d694d4fc27 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:57.989379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d2e2d-1be5-40d7-9e56-23d694d4fc27 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:57.994611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed43fc-aba9-425f-a2d4-fece36a6be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:57.995664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed43fc-aba9-425f-a2d4-fece36a6be4d admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:57.996174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed43fc-aba9-425f-a2d4-fece36a6be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:57.996685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed43fc-aba9-425f-a2d4-fece36a6be4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:57.997580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed43fc-aba9-425f-a2d4-fece36a6be4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:57.999840 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed43fc-aba9-425f-a2d4-fece36a6be4d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:58.014423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1276/2562] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:29:58.021141 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed43fc-aba9-425f-a2d4-fece36a6be4d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:58.032564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed43fc-aba9-425f-a2d4-fece36a6be4d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:58.048001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c95ff-0d2c-44d4-95f9-15af042fa9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:58.048842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c95ff-0d2c-44d4-95f9-15af042fa9ea admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.049218 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c95ff-0d2c-44d4-95f9-15af042fa9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.049611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c95ff-0d2c-44d4-95f9-15af042fa9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.050449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c95ff-0d2c-44d4-95f9-15af042fa9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:58.052497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c95ff-0d2c-44d4-95f9-15af042fa9ea admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:58.067343 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1277/2563] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:29:58.068647 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c95ff-0d2c-44d4-95f9-15af042fa9ea admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:58.074759 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:58.081012 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c95ff-0d2c-44d4-95f9-15af042fa9ea admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:58.086753 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb69ba1-c5d1-4e3c-9c95-ebb959ed2038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:58.087405 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69ba1-c5d1-4e3c-9c95-ebb959ed2038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.087726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69ba1-c5d1-4e3c-9c95-ebb959ed2038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.087997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69ba1-c5d1-4e3c-9c95-ebb959ed2038 admin admin] PATH_INFO: `/v3/projects/7c235b61de1e40e2821f59d4a7e1f734/users/1ad52b1a345346fc91c2c6477b5f9ac2/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.103529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb69ba1-c5d1-4e3c-9c95-ebb959ed2038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c235b61de1e40e2821f59d4a7e1f734, user_id=1ad52b1a345346fc91c2c6477b5f9ac2, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:58.106445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb69ba1-c5d1-4e3c-9c95-ebb959ed2038 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:58.137876 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871632d89b5d426fb40f41d4e4b44031'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.138533 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871632d89b5d426fb40f41d4e4b44031'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.204728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871632d89b5d426fb40f41d4e4b44031'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.214686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1278/2564] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:29:58 2022] PUT /identity/v3/projects/7c235b61de1e40e2821f59d4a7e1f734/users/1ad52b1a345346fc91c2c6477b5f9ac2/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:58.222168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871632d89b5d426fb40f41d4e4b44031'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.223438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97dd4-07e3-4e72-88d4-4c2e0707b0de None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.223783 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97dd4-07e3-4e72-88d4-4c2e0707b0de None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.224147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97dd4-07e3-4e72-88d4-4c2e0707b0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.230364 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:58.236986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-5ae2eed7-1964-4ed7-8090-819a7617b65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871632d89b5d426fb40f41d4e4b44031'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.244258 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1287/2565] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:57 2022] DELETE /identity/v3/users/871632d89b5d426fb40f41d4e4b44031 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:58.248519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719edcd-0fc2-4909-8d23-42f6bcdb80fa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.248802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719edcd-0fc2-4909-8d23-42f6bcdb80fa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.249075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719edcd-0fc2-4909-8d23-42f6bcdb80fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.256802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-dcf97dd4-07e3-4e72-88d4-4c2e0707b0de None None] MFA Rules not processed for user `1ad52b1a345346fc91c2c6477b5f9ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:58.258041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-dcf97dd4-07e3-4e72-88d4-4c2e0707b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:58.272849 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9719edcd-0fc2-4909-8d23-42f6bcdb80fa None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:58.274096 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9719edcd-0fc2-4909-8d23-42f6bcdb80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:58.323245 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1279/2566] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:58.334445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1288/2567] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:29:58.334975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf97dd4-07e3-4e72-88d4-4c2e0707b0de None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:58.336470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-dcf97dd4-07e3-4e72-88d4-4c2e0707b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:58.344603 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719edcd-0fc2-4909-8d23-42f6bcdb80fa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:58.346080 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9719edcd-0fc2-4909-8d23-42f6bcdb80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:58.395897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf97dd4-07e3-4e72-88d4-4c2e0707b0de None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:58.399527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:58.400133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.400440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.400710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.404193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719edcd-0fc2-4909-8d23-42f6bcdb80fa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:58.407968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0f07b-b79a-43fd-bd54-c37aaea7dd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:58.408593 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0f07b-b79a-43fd-bd54-c37aaea7dd77 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.408872 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0f07b-b79a-43fd-bd54-c37aaea7dd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.409145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0f07b-b79a-43fd-bd54-c37aaea7dd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.409244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:58.410597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:58.418741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0f07b-b79a-43fd-bd54-c37aaea7dd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:58.419378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1280/2568] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:58.419505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0f07b-b79a-43fd-bd54-c37aaea7dd77 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:58.430621 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1289/2569] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:58.447947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:58.451533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:58.464912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055530e2-2bb1-4ceb-8c9b-a190944a0317 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:58.470555 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:58.471185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.471462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.471732 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] PATH_INFO: `/v3/users/1ad52b1a345346fc91c2c6477b5f9ac2` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.472915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad52b1a345346fc91c2c6477b5f9ac2)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:58.475282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:58.653414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad52b1a345346fc91c2c6477b5f9ac2'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.729698 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad52b1a345346fc91c2c6477b5f9ac2'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.730482 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad52b1a345346fc91c2c6477b5f9ac2'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.739630 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:58.744300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad52b1a345346fc91c2c6477b5f9ac2'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.745055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad52b1a345346fc91c2c6477b5f9ac2'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:58.757564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1281/2570] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:58 2022] DELETE /identity/v3/users/1ad52b1a345346fc91c2c6477b5f9ac2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:58.762044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da726-7324-43dd-a338-4317adcfa7ac None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.762332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da726-7324-43dd-a338-4317adcfa7ac None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.762634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da726-7324-43dd-a338-4317adcfa7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.782305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-837da726-7324-43dd-a338-4317adcfa7ac None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:58.783572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-837da726-7324-43dd-a338-4317adcfa7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:58.854866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1290/2571] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:58.863668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:58.865133 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837da726-7324-43dd-a338-4317adcfa7ac None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:58.865591 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:58.867026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-837da726-7324-43dd-a338-4317adcfa7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:58.880531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6e645-40f3-4770-b339-7067756f3886 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:58.885721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:58.886359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.886639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.886913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] PATH_INFO: `/v3/projects/4530064f82eb4980b34e9ca080d521b5` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.888191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4530064f82eb4980b34e9ca080d521b5)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:58.890369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:58.909279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:58.931578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837da726-7324-43dd-a338-4317adcfa7ac None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:58.935163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e69ac-aeaf-46ad-bef3-6097f586d895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:58.935771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e69ac-aeaf-46ad-bef3-6097f586d895 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:58.936048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e69ac-aeaf-46ad-bef3-6097f586d895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:58.936337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e69ac-aeaf-46ad-bef3-6097f586d895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:58.945646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e69ac-aeaf-46ad-bef3-6097f586d895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:58.947100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e69ac-aeaf-46ad-bef3-6097f586d895 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:58.957597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1291/2572] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:29:59.007298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4530064f82eb4980b34e9ca080d521b5', 'request_id': 'req-e53525bc-b694-40ae-9047-4ed4533ef259'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.013524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4530064f82eb4980b34e9ca080d521b5', 'request_id': 'req-e53525bc-b694-40ae-9047-4ed4533ef259'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.019871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4530064f82eb4980b34e9ca080d521b5', 'request_id': 'req-e53525bc-b694-40ae-9047-4ed4533ef259'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.128400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] The token cache is being invalidate because project 4530064f82eb4980b34e9ca080d521b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:59.128679 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.130395 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.130785 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1282/2573] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:58 2022] DELETE /identity/v3/projects/4530064f82eb4980b34e9ca080d521b5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:59.134916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e69ac-aeaf-46ad-bef3-6097f586d895 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:59.145135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e69ac-aeaf-46ad-bef3-6097f586d895 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:59.211588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:59.212530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:59.212798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:59.213132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] PATH_INFO: `/v3/users/3c0bfcc9c53749c6b7ba8f387167df03` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:59.215001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0bfcc9c53749c6b7ba8f387167df03)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:59.217513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:59.428532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0bfcc9c53749c6b7ba8f387167df03'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.429184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0bfcc9c53749c6b7ba8f387167df03'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.490599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:29:59.492096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:59.507255 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53525bc-b694-40ae-9047-4ed4533ef259 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:29:59.511950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:29:59.512673 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:59.512897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:59.513223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] PATH_INFO: `/v3/projects/7c235b61de1e40e2821f59d4a7e1f734` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:59.514327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c235b61de1e40e2821f59d4a7e1f734)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:29:59.516148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:29:59.598291 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0bfcc9c53749c6b7ba8f387167df03'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.612680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0bfcc9c53749c6b7ba8f387167df03'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.629394 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fb56cb33-b10f-42ce-a0f5-cc7f7b36ad96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0bfcc9c53749c6b7ba8f387167df03'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.639448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1292/2574] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:29:59 2022] DELETE /identity/v3/users/3c0bfcc9c53749c6b7ba8f387167df03 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:29:59.721611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c235b61de1e40e2821f59d4a7e1f734', 'request_id': 'req-02dd9e90-9a17-483e-8d88-b1ee8791a36a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.728737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c235b61de1e40e2821f59d4a7e1f734', 'request_id': 'req-02dd9e90-9a17-483e-8d88-b1ee8791a36a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.735652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c235b61de1e40e2821f59d4a7e1f734', 'request_id': 'req-02dd9e90-9a17-483e-8d88-b1ee8791a36a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.849886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] The token cache is being invalidate because project 7c235b61de1e40e2821f59d4a7e1f734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:29:59.850189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.850871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-02dd9e90-9a17-483e-8d88-b1ee8791a36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:29:59.852655 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1283/2575] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:29:59 2022] DELETE /identity/v3/projects/7c235b61de1e40e2821f59d4a7e1f734 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:29:59.859228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4264b-0499-41b3-a3cc-a643aa811c32 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:59.859228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4264b-0499-41b3-a3cc-a643aa811c32 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:59.859228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4264b-0499-41b3-a3cc-a643aa811c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:59.881182 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c0c4264b-0499-41b3-a3cc-a643aa811c32 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:59.882486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c0c4264b-0499-41b3-a3cc-a643aa811c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:29:59.945890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:59.958741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1293/2576] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:29:59.968093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e754-25e0-4ebc-bea4-f20832f21cfc None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:29:59.968742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e754-25e0-4ebc-bea4-f20832f21cfc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:29:59.969426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e754-25e0-4ebc-bea4-f20832f21cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:29:59.994895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e7c2e754-25e0-4ebc-bea4-f20832f21cfc None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:29:59.996495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e7c2e754-25e0-4ebc-bea4-f20832f21cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:00.011834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1284/2577] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:00.013154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4264b-0499-41b3-a3cc-a643aa811c32 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.034370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4264b-0499-41b3-a3cc-a643aa811c32 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.039323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.040043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.040403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.040747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.041479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:00.041856 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.043622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.057439 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1294/2578] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:00.062107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2e754-25e0-4ebc-bea4-f20832f21cfc None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.072424 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2e754-25e0-4ebc-bea4-f20832f21cfc None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.083044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26b19e-f564-486c-95e6-a7456824b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.083044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b19e-f564-486c-95e6-a7456824b1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.083044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b19e-f564-486c-95e6-a7456824b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.083044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26b19e-f564-486c-95e6-a7456824b1f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.083471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26b19e-f564-486c-95e6-a7456824b1f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.083471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26b19e-f564-486c-95e6-a7456824b1f3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.102671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.104470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:00.118415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8fc56-a96f-4c91-a6dd-262cf6ea5488 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.123990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.125095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.135045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.135045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] PATH_INFO: `/v3/projects/75317f64888c4837b5f4a6edaa7dbe60` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.135045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=75317f64888c4837b5f4a6edaa7dbe60)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.135045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.187854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1285/2579] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:00 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:00.192491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26b19e-f564-486c-95e6-a7456824b1f3 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.216859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:00.264529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26b19e-f564-486c-95e6-a7456824b1f3 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.276065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75317f64888c4837b5f4a6edaa7dbe60', 'request_id': 'req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.282126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75317f64888c4837b5f4a6edaa7dbe60', 'request_id': 'req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.289281 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75317f64888c4837b5f4a6edaa7dbe60', 'request_id': 'req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.322062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.339626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.339626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.339626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.339626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.339626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.393309 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] The token cache is being invalidate because project 75317f64888c4837b5f4a6edaa7dbe60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:00.393602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.394298 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.396075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1295/2580] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:00 2022] DELETE /identity/v3/projects/75317f64888c4837b5f4a6edaa7dbe60 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:00.399870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.401214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:00.415571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f695c58-3a4c-413b-a4e7-3aa66ee5e3ae admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.416036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1286/2581] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:00 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:00.423088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.424359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.424556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.424831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] PATH_INFO: `/v3/users/a8f344d5956149ebabe7bbd625c39173` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.426001 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f344d5956149ebabe7bbd625c39173)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.428023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.429394 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.431221 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:00.443986 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058128e2-bff0-498b-abea-2e2e470aaf66 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.448995 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdc2fe-fb44-4606-84b9-059acf149753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.449638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdc2fe-fb44-4606-84b9-059acf149753 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.449919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdc2fe-fb44-4606-84b9-059acf149753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.450197 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdc2fe-fb44-4606-84b9-059acf149753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.450883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdc2fe-fb44-4606-84b9-059acf149753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.452507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdc2fe-fb44-4606-84b9-059acf149753 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.462907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1287/2582] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:00.466815 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdc2fe-fb44-4606-84b9-059acf149753 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.477314 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdc2fe-fb44-4606-84b9-059acf149753 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.482073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc90e3-6b72-46ac-9340-4072e90b5348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.482668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc90e3-6b72-46ac-9340-4072e90b5348 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.482949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc90e3-6b72-46ac-9340-4072e90b5348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.483224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc90e3-6b72-46ac-9340-4072e90b5348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.483868 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc90e3-6b72-46ac-9340-4072e90b5348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.486446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc90e3-6b72-46ac-9340-4072e90b5348 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.498169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1288/2583] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:00.502136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc90e3-6b72-46ac-9340-4072e90b5348 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.512094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc90e3-6b72-46ac-9340-4072e90b5348 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.523652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fcec-9388-4179-821f-0fd90ec7af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.524450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fcec-9388-4179-821f-0fd90ec7af9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.524621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fcec-9388-4179-821f-0fd90ec7af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.525030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fcec-9388-4179-821f-0fd90ec7af9d admin admin] PATH_INFO: `/v3/projects/107d777cdd074bc2ae78b59d3fc19392/users/deac7740a1364c50b3d5b110e227978b/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.545663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94fcec-9388-4179-821f-0fd90ec7af9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=107d777cdd074bc2ae78b59d3fc19392, user_id=deac7740a1364c50b3d5b110e227978b, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.549136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94fcec-9388-4179-821f-0fd90ec7af9d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.619175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1289/2584] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:00 2022] PUT /identity/v3/projects/107d777cdd074bc2ae78b59d3fc19392/users/deac7740a1364c50b3d5b110e227978b/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:00.620651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef8ce-b81c-4088-bd04-d0873f02cf0e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.620851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f344d5956149ebabe7bbd625c39173'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.621293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef8ce-b81c-4088-bd04-d0873f02cf0e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.621293 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef8ce-b81c-4088-bd04-d0873f02cf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.621679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f344d5956149ebabe7bbd625c39173'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.651369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-383ef8ce-b81c-4088-bd04-d0873f02cf0e None None] MFA Rules not processed for user `deac7740a1364c50b3d5b110e227978b`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:00.652607 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-383ef8ce-b81c-4088-bd04-d0873f02cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:00.699965 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f344d5956149ebabe7bbd625c39173'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.708528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f344d5956149ebabe7bbd625c39173'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.733110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1290/2585] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:00.737504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef8ce-b81c-4088-bd04-d0873f02cf0e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:00.738945 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-383ef8ce-b81c-4088-bd04-d0873f02cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:00.739857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f344d5956149ebabe7bbd625c39173'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:00.746563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1296/2586] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:00 2022] DELETE /identity/v3/users/a8f344d5956149ebabe7bbd625c39173 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:00.809184 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef8ce-b81c-4088-bd04-d0873f02cf0e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:00.860548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbe73-95ef-44ee-a99e-2f11bbd9fbb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:00.861151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbe73-95ef-44ee-a99e-2f11bbd9fbb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:00.861437 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbe73-95ef-44ee-a99e-2f11bbd9fbb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:00.861708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbe73-95ef-44ee-a99e-2f11bbd9fbb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:00.926762 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedbe73-95ef-44ee-a99e-2f11bbd9fbb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:00.928575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedbe73-95ef-44ee-a99e-2f11bbd9fbb6 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:00.938631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1291/2587] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:01.165760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:01.168822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:01.213759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:01.221153 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:01.239263 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a17d00-46ca-4609-9519-5660f2f9c819 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:01.243910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:01.244599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.244874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.245154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] PATH_INFO: `/v3/projects/a3761d7ceea147d286b41f074614cc66` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.246304 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3761d7ceea147d286b41f074614cc66)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:01.248230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:01.345117 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3761d7ceea147d286b41f074614cc66', 'request_id': 'req-a247782b-28ce-4a71-93f7-02eeb1378755'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.350945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3761d7ceea147d286b41f074614cc66', 'request_id': 'req-a247782b-28ce-4a71-93f7-02eeb1378755'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.357023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3761d7ceea147d286b41f074614cc66', 'request_id': 'req-a247782b-28ce-4a71-93f7-02eeb1378755'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.443783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] The token cache is being invalidate because project a3761d7ceea147d286b41f074614cc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:01.444073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.444717 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a247782b-28ce-4a71-93f7-02eeb1378755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.446267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1297/2588] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:01 2022] DELETE /identity/v3/projects/a3761d7ceea147d286b41f074614cc66 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:01.453117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0c97d-c1b9-4840-9b65-c45de7d4b832 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.453415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0c97d-c1b9-4840-9b65-c45de7d4b832 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.453677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0c97d-c1b9-4840-9b65-c45de7d4b832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.473133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-fad0c97d-c1b9-4840-9b65-c45de7d4b832 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:01.474407 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fad0c97d-c1b9-4840-9b65-c45de7d4b832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:01.539645 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1292/2589] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:01.547923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a544e13-4d28-4aa5-b198-f100944757dd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.548378 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a544e13-4d28-4aa5-b198-f100944757dd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.549185 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a544e13-4d28-4aa5-b198-f100944757dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.570727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6a544e13-4d28-4aa5-b198-f100944757dd None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:01.571911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6a544e13-4d28-4aa5-b198-f100944757dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:01.587592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1298/2590] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:01.592519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0c97d-c1b9-4840-9b65-c45de7d4b832 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:01.608266 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0c97d-c1b9-4840-9b65-c45de7d4b832 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:01.615205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:01.615205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.615415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.615613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.616235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:01.616704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:01.618390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:01.635093 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a544e13-4d28-4aa5-b198-f100944757dd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:01.636086 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1293/2591] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:01.637079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6a544e13-4d28-4aa5-b198-f100944757dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:01.640254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:01.650754 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a544e13-4d28-4aa5-b198-f100944757dd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:01.650933 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254ab4-0ae1-424e-b372-c681c94db100 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:01.655528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212672d-1f23-417d-82e4-00e04e64cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:01.655780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:01.656122 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212672d-1f23-417d-82e4-00e04e64cb00 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.656431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.656538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212672d-1f23-417d-82e4-00e04e64cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.656730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212672d-1f23-417d-82e4-00e04e64cb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.656826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.656977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] PATH_INFO: `/v3/users/b3fc246dc14d4a17ae1d8c731fd68444` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.657319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212672d-1f23-417d-82e4-00e04e64cb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:01.658729 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fc246dc14d4a17ae1d8c731fd68444)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:01.660924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:01.661048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212672d-1f23-417d-82e4-00e04e64cb00 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:01.667205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:01.742841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1294/2592] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:01 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:01.746465 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212672d-1f23-417d-82e4-00e04e64cb00 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:01.810198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212672d-1f23-417d-82e4-00e04e64cb00 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:01.821513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:01.822138 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.822417 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.822694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.823324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:01.825415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:01.853021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fc246dc14d4a17ae1d8c731fd68444'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.853675 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fc246dc14d4a17ae1d8c731fd68444'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.958186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fc246dc14d4a17ae1d8c731fd68444'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.964871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1295/2593] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:01 2022] POST /identity/v3/users => generated 301 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:01.968804 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:01.969888 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fc246dc14d4a17ae1d8c731fd68444'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.970666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:01.982653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3b9dcdea-5152-4eaf-ab3e-1a5f6271beb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fc246dc14d4a17ae1d8c731fd68444'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:01.986122 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fd3e3-6644-4352-970f-4672194e1309 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:01.989116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1299/2594] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:01 2022] DELETE /identity/v3/users/b3fc246dc14d4a17ae1d8c731fd68444 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:01.992277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70031f3c-3bcd-4148-a69f-53d1a4b379fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:01.992917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031f3c-3bcd-4148-a69f-53d1a4b379fc admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.993165 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7f01-b4d0-44dd-8a59-fb0a0ca6922c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:01.993297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031f3c-3bcd-4148-a69f-53d1a4b379fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.993454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7f01-b4d0-44dd-8a59-fb0a0ca6922c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:01.993566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031f3c-3bcd-4148-a69f-53d1a4b379fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.993728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7f01-b4d0-44dd-8a59-fb0a0ca6922c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:01.994202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70031f3c-3bcd-4148-a69f-53d1a4b379fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:01.995769 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70031f3c-3bcd-4148-a69f-53d1a4b379fc admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.006665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1296/2595] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:02.011694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70031f3c-3bcd-4148-a69f-53d1a4b379fc admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.014731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6bbe7f01-b4d0-44dd-8a59-fb0a0ca6922c None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:02.014928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6bbe7f01-b4d0-44dd-8a59-fb0a0ca6922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:02.025202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70031f3c-3bcd-4148-a69f-53d1a4b379fc admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.049807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:02.088519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1300/2596] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:02.092633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7f01-b4d0-44dd-8a59-fb0a0ca6922c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.093971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6bbe7f01-b4d0-44dd-8a59-fb0a0ca6922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:02.094094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f37c08-9bdc-42dc-b9c1-17b19c9e29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.095448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f37c08-9bdc-42dc-b9c1-17b19c9e29c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.095448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f37c08-9bdc-42dc-b9c1-17b19c9e29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.095448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f37c08-9bdc-42dc-b9c1-17b19c9e29c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.096333 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f37c08-9bdc-42dc-b9c1-17b19c9e29c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:02.098450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f37c08-9bdc-42dc-b9c1-17b19c9e29c2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.113217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1297/2597] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:02.114274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f37c08-9bdc-42dc-b9c1-17b19c9e29c2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.124065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f37c08-9bdc-42dc-b9c1-17b19c9e29c2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.129464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8de2d-4f78-4f8d-a527-c304e0f12345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.130101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8de2d-4f78-4f8d-a527-c304e0f12345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.130381 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8de2d-4f78-4f8d-a527-c304e0f12345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.130684 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8de2d-4f78-4f8d-a527-c304e0f12345 admin admin] PATH_INFO: `/v3/projects/16d5e2c7494641b7b2a388fe29d38abd/users/f01782ed656a4c5a8db138c1a67ed41c/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.147084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8de2d-4f78-4f8d-a527-c304e0f12345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d5e2c7494641b7b2a388fe29d38abd, user_id=f01782ed656a4c5a8db138c1a67ed41c, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:02.149852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8de2d-4f78-4f8d-a527-c304e0f12345 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.154953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7f01-b4d0-44dd-8a59-fb0a0ca6922c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.159384 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f19fd-48a8-4932-be8a-d90db12d7e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.159977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f19fd-48a8-4932-be8a-d90db12d7e93 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.160251 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f19fd-48a8-4932-be8a-d90db12d7e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.160552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f19fd-48a8-4932-be8a-d90db12d7e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.169499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f19fd-48a8-4932-be8a-d90db12d7e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:02.170963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f19fd-48a8-4932-be8a-d90db12d7e93 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.181207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1301/2598] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:02.250146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1298/2599] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:02 2022] PUT /identity/v3/projects/16d5e2c7494641b7b2a388fe29d38abd/users/f01782ed656a4c5a8db138c1a67ed41c/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:02.263827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951d74-0b47-422c-be2e-184365487967 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.264286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951d74-0b47-422c-be2e-184365487967 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.264655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd951d74-0b47-422c-be2e-184365487967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.291995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fd951d74-0b47-422c-be2e-184365487967 None None] MFA Rules not processed for user `f01782ed656a4c5a8db138c1a67ed41c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:02.293297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fd951d74-0b47-422c-be2e-184365487967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:02.358196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1302/2600] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:02.363401 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8de2d-4f78-4f8d-a527-c304e0f12345 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.399396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:02.434151 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8de2d-4f78-4f8d-a527-c304e0f12345 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.438885 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79008-757a-4e63-b385-873eef1cd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.439520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79008-757a-4e63-b385-873eef1cd830 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.439797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79008-757a-4e63-b385-873eef1cd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.440068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79008-757a-4e63-b385-873eef1cd830 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.440739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e79008-757a-4e63-b385-873eef1cd830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:02.442712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e79008-757a-4e63-b385-873eef1cd830 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.578504 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd951d74-0b47-422c-be2e-184365487967 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.579476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1299/2601] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:02 2022] POST /identity/v3/projects => generated 399 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:02.583415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fd951d74-0b47-422c-be2e-184365487967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:02.583562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79008-757a-4e63-b385-873eef1cd830 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.602680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd951d74-0b47-422c-be2e-184365487967 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.666803 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.667508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.667698 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.667972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] PATH_INFO: `/v3/projects/a3d6fab12806468786dcd38ae90c3dff` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.669870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d6fab12806468786dcd38ae90c3dff)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:02.672059 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.673040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79008-757a-4e63-b385-873eef1cd830 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.678757 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e63506-5d30-4c21-a306-b3cb41c06fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.679385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63506-5d30-4c21-a306-b3cb41c06fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.679664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63506-5d30-4c21-a306-b3cb41c06fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.679940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63506-5d30-4c21-a306-b3cb41c06fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.680597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e63506-5d30-4c21-a306-b3cb41c06fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:02.680970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:02.682536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e63506-5d30-4c21-a306-b3cb41c06fd9 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.787252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1300/2602] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:02 2022] POST /identity/v3/users => generated 306 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:02.788613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08661a5-bd2c-44c0-ba4b-205a34abcd54 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.788904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08661a5-bd2c-44c0-ba4b-205a34abcd54 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.789179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08661a5-bd2c-44c0-ba4b-205a34abcd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.807536 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-b08661a5-bd2c-44c0-ba4b-205a34abcd54 None None] MFA Rules not processed for user `deac7740a1364c50b3d5b110e227978b`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:02.808772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b08661a5-bd2c-44c0-ba4b-205a34abcd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:02.822785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d6fab12806468786dcd38ae90c3dff', 'request_id': 'req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:02.828390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d6fab12806468786dcd38ae90c3dff', 'request_id': 'req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:02.835796 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d6fab12806468786dcd38ae90c3dff', 'request_id': 'req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:02.869729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1301/2603] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:02.870622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08661a5-bd2c-44c0-ba4b-205a34abcd54 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.924611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] The token cache is being invalidate because project a3d6fab12806468786dcd38ae90c3dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:02.925268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:02.925438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:02.926002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:02.927746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1303/2604] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:02 2022] DELETE /identity/v3/projects/a3d6fab12806468786dcd38ae90c3dff => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:02.932130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.933273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:02.942149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08661a5-bd2c-44c0-ba4b-205a34abcd54 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.947613 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9262e3-b5f1-4f7c-b4f4-5e29ce8fc380 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.948505 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.949256 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.949540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.949810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.950798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:02.952572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.952699 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.953191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.953473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.953743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] PATH_INFO: `/v3/users/5c7f6ba460654bd995f15aa19c3a58cf` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:02.954944 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7f6ba460654bd995f15aa19c3a58cf)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:02.956928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:02.968125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1302/2605] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:02.969537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:02.971707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:02.989639 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d41e3-79ff-48b5-bfbb-eea18b67f1b6 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:02.992351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82dcd2-e626-46d3-bcbf-2b6ca8414e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:02.993025 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82dcd2-e626-46d3-bcbf-2b6ca8414e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:02.993309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82dcd2-e626-46d3-bcbf-2b6ca8414e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:02.993585 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82dcd2-e626-46d3-bcbf-2b6ca8414e49 admin admin] PATH_INFO: `/v3/projects/3ec0b79555244de880bb9ca6d72a53d3/users/488446a7e8ab4257ba4096997c54f543/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:03.009313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82dcd2-e626-46d3-bcbf-2b6ca8414e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec0b79555244de880bb9ca6d72a53d3, user_id=488446a7e8ab4257ba4096997c54f543, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:03.011976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82dcd2-e626-46d3-bcbf-2b6ca8414e49 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:03.116379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1303/2606] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:02 2022] PUT /identity/v3/projects/3ec0b79555244de880bb9ca6d72a53d3/users/488446a7e8ab4257ba4096997c54f543/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:03.117477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82dcd2-e626-46d3-bcbf-2b6ca8414e49 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:03.151654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7f6ba460654bd995f15aa19c3a58cf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:03.153041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7f6ba460654bd995f15aa19c3a58cf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:03.221793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82dcd2-e626-46d3-bcbf-2b6ca8414e49 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:03.228488 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:03.229166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:03.229447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:03.229718 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:03.230527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:03.232210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:03.243742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1304/2607] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:03.244503 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:03.246980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:03.249468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7f6ba460654bd995f15aa19c3a58cf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:03.258355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7f6ba460654bd995f15aa19c3a58cf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:03.275606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7f6ba460654bd995f15aa19c3a58cf'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:03.286386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1304/2608] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:02 2022] DELETE /identity/v3/users/5c7f6ba460654bd995f15aa19c3a58cf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:03.286386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:03.286386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:03.324920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e532156-cd3e-4f0d-bfc8-a3d141dba5da admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:03.359835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394dafa-f0be-4449-8eb4-f439f1536b74 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:03.365902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f639-1361-4745-91ce-70ec3b125c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:03.366441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f639-1361-4745-91ce-70ec3b125c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:03.366839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f639-1361-4745-91ce-70ec3b125c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:03.367618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f639-1361-4745-91ce-70ec3b125c81 admin admin] PATH_INFO: `/v3/projects/3ec0b79555244de880bb9ca6d72a53d3/users/488446a7e8ab4257ba4096997c54f543/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:03.369786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1f639-1361-4745-91ce-70ec3b125c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec0b79555244de880bb9ca6d72a53d3, user_id=488446a7e8ab4257ba4096997c54f543, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:03.372758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1f639-1361-4745-91ce-70ec3b125c81 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:03.380010 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:03.380685 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:03.380951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:03.381220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:03.382955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:03.395175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1305/2609] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:03 2022] PUT /identity/v3/projects/3ec0b79555244de880bb9ca6d72a53d3/users/488446a7e8ab4257ba4096997c54f543/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:03.396090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:03.396986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1aad8-2969-464f-abe8-77d1f5f5f885 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:03.397279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1aad8-2969-464f-abe8-77d1f5f5f885 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:03.397563 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1aad8-2969-464f-abe8-77d1f5f5f885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:03.398246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:03.404745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:03.411772 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1305/2610] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:03.440661 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-03f1aad8-2969-464f-abe8-77d1f5f5f885 None None] MFA Rules not processed for user `488446a7e8ab4257ba4096997c54f543`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:03.441918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-03f1aad8-2969-464f-abe8-77d1f5f5f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:03.529406 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1306/2611] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:03 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:03.551110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:03.552572 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:03.574282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:03.633976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988ab63-391d-442f-badc-8f1b0fdcf478 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:03.688771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fdba8-0111-46a1-b77f-c28bec5c3bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:03.690852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fdba8-0111-46a1-b77f-c28bec5c3bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:03.691139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fdba8-0111-46a1-b77f-c28bec5c3bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:03.691530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fdba8-0111-46a1-b77f-c28bec5c3bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:03.700827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fdba8-0111-46a1-b77f-c28bec5c3bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:03.702372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fdba8-0111-46a1-b77f-c28bec5c3bb8 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:03.712222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1306/2612] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:03 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:03.777913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1aad8-2969-464f-abe8-77d1f5f5f885 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:03.779734 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-03f1aad8-2969-464f-abe8-77d1f5f5f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:03.878901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1aad8-2969-464f-abe8-77d1f5f5f885 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:03.883585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:03.884332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:03.884696 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:03.885038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] PATH_INFO: `/v3/projects/676c92ddd6ac4f5ebd165601c4d7b752` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:03.886231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=676c92ddd6ac4f5ebd165601c4d7b752)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:03.888226 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:04.035172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fdba8-0111-46a1-b77f-c28bec5c3bb8 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:04.043705 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676c92ddd6ac4f5ebd165601c4d7b752', 'request_id': 'req-549547ee-f8c4-40ac-9390-2c9a444e4ec2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:04.045662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fdba8-0111-46a1-b77f-c28bec5c3bb8 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:04.050810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676c92ddd6ac4f5ebd165601c4d7b752', 'request_id': 'req-549547ee-f8c4-40ac-9390-2c9a444e4ec2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:04.059571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676c92ddd6ac4f5ebd165601c4d7b752', 'request_id': 'req-549547ee-f8c4-40ac-9390-2c9a444e4ec2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:04.110413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac564f-7be3-46d0-8d68-256470c9bbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:04.110884 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac564f-7be3-46d0-8d68-256470c9bbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.111755 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac564f-7be3-46d0-8d68-256470c9bbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.112238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac564f-7be3-46d0-8d68-256470c9bbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.114365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ecac564f-7be3-46d0-8d68-256470c9bbd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:04.148881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] The token cache is being invalidate because project 676c92ddd6ac4f5ebd165601c4d7b752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:04.149178 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:04.151231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-549547ee-f8c4-40ac-9390-2c9a444e4ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:04.156069 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1307/2613] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:03 2022] DELETE /identity/v3/projects/676c92ddd6ac4f5ebd165601c4d7b752 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:04.158935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9d07c-66c1-45b1-9692-afcbdc633858 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.159228 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9d07c-66c1-45b1-9692-afcbdc633858 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.159726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9d07c-66c1-45b1-9692-afcbdc633858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.181468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a1f9d07c-66c1-45b1-9692-afcbdc633858 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:04.182684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a1f9d07c-66c1-45b1-9692-afcbdc633858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:04.197119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac564f-7be3-46d0-8d68-256470c9bbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:04.199553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac564f-7be3-46d0-8d68-256470c9bbd8 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:04.202000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:04.211619 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1307/2614] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:04 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:04.277929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1308/2615] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:04.286819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d26f7-31cd-452d-9757-07c8ef8bbc45 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.287258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d26f7-31cd-452d-9757-07c8ef8bbc45 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.287630 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d26f7-31cd-452d-9757-07c8ef8bbc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.313320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-fa4d26f7-31cd-452d-9757-07c8ef8bbc45 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:04.315378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fa4d26f7-31cd-452d-9757-07c8ef8bbc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:04.329409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1308/2616] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:04.331085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9d07c-66c1-45b1-9692-afcbdc633858 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:04.345005 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9d07c-66c1-45b1-9692-afcbdc633858 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:04.352928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:04.354677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.354956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.359936 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.360684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:04.361746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:04.363236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:04.377725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1309/2617] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:04.386614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d26f7-31cd-452d-9757-07c8ef8bbc45 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:04.406171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d26f7-31cd-452d-9757-07c8ef8bbc45 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:04.412897 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff7f93-8820-4232-bac7-497681d77552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:04.414714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff7f93-8820-4232-bac7-497681d77552 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.414850 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff7f93-8820-4232-bac7-497681d77552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.415368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff7f93-8820-4232-bac7-497681d77552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.416169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff7f93-8820-4232-bac7-497681d77552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:04.419062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff7f93-8820-4232-bac7-497681d77552 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:04.536186 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:04.544258 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1309/2618] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:04 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:04.549329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:04.559283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8acd0-36f4-4351-bac2-dd058284aa5f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:04.624780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49fac9-029f-43fb-8510-11c06d3cc0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:04.625467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49fac9-029f-43fb-8510-11c06d3cc0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.625723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49fac9-029f-43fb-8510-11c06d3cc0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.625942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49fac9-029f-43fb-8510-11c06d3cc0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.627905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49fac9-029f-43fb-8510-11c06d3cc0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:04.630471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49fac9-029f-43fb-8510-11c06d3cc0d2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:04.721086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1310/2619] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:04 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:04.725966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff7f93-8820-4232-bac7-497681d77552 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:04.753521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff7f93-8820-4232-bac7-497681d77552 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:04.762427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015664e-cc22-48ea-bc24-1829c050cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:04.763832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015664e-cc22-48ea-bc24-1829c050cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.764563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015664e-cc22-48ea-bc24-1829c050cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.765234 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015664e-cc22-48ea-bc24-1829c050cd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.766578 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015664e-cc22-48ea-bc24-1829c050cd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:04.769223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015664e-cc22-48ea-bc24-1829c050cd41 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:04.786971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1310/2620] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:04.791822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49fac9-029f-43fb-8510-11c06d3cc0d2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:04.816261 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49fac9-029f-43fb-8510-11c06d3cc0d2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:04.837559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465dea3-90e1-414b-b9c3-85b23bb73843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:04.838444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dea3-90e1-414b-b9c3-85b23bb73843 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.838825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dea3-90e1-414b-b9c3-85b23bb73843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.839188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dea3-90e1-414b-b9c3-85b23bb73843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.840122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465dea3-90e1-414b-b9c3-85b23bb73843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:04.842050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465dea3-90e1-414b-b9c3-85b23bb73843 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:04.860998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1311/2621] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:04.863480 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015664e-cc22-48ea-bc24-1829c050cd41 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:04.876632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015664e-cc22-48ea-bc24-1829c050cd41 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:04.884726 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cde3b-f9fc-49f6-b071-777e7a3dbc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:04.885055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cde3b-f9fc-49f6-b071-777e7a3dbc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:04.885337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cde3b-f9fc-49f6-b071-777e7a3dbc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:04.885947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cde3b-f9fc-49f6-b071-777e7a3dbc76 admin admin] PATH_INFO: `/v3/projects/509759dadfbf463b88ea0b23e6e63e8a/users/1bdf254b60fd4c229c9c1a698fad7520/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:04.904060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cde3b-f9fc-49f6-b071-777e7a3dbc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509759dadfbf463b88ea0b23e6e63e8a, user_id=1bdf254b60fd4c229c9c1a698fad7520, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:04.906916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cde3b-f9fc-49f6-b071-777e7a3dbc76 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:05.067532 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1311/2622] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:04 2022] PUT /identity/v3/projects/509759dadfbf463b88ea0b23e6e63e8a/users/1bdf254b60fd4c229c9c1a698fad7520/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:05.086373 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f923-7268-4be8-96dd-5e22fd74ecdb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:05.086664 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f923-7268-4be8-96dd-5e22fd74ecdb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:05.086978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f923-7268-4be8-96dd-5e22fd74ecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:05.128029 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4bd8f923-7268-4be8-96dd-5e22fd74ecdb None None] MFA Rules not processed for user `1bdf254b60fd4c229c9c1a698fad7520`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:05.129283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4bd8f923-7268-4be8-96dd-5e22fd74ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:05.215517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1312/2623] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:05.220493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cde3b-f9fc-49f6-b071-777e7a3dbc76 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:05.294731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cde3b-f9fc-49f6-b071-777e7a3dbc76 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:05.300015 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77573c7-a1e6-43e0-a0fa-12d0ca93b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:05.300834 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77573c7-a1e6-43e0-a0fa-12d0ca93b30e admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:05.301115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77573c7-a1e6-43e0-a0fa-12d0ca93b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:05.301810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77573c7-a1e6-43e0-a0fa-12d0ca93b30e admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:05.302087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77573c7-a1e6-43e0-a0fa-12d0ca93b30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:05.304026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77573c7-a1e6-43e0-a0fa-12d0ca93b30e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:05.409362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1312/2624] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:05 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:05.410285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8f923-7268-4be8-96dd-5e22fd74ecdb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:05.421509 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8f923-7268-4be8-96dd-5e22fd74ecdb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:05.431755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:05.482286 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daa70b-fa18-4872-9727-9b69c05b07b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:05.482950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa70b-fa18-4872-9727-9b69c05b07b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:05.483231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa70b-fa18-4872-9727-9b69c05b07b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:05.483499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa70b-fa18-4872-9727-9b69c05b07b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:05.484872 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daa70b-fa18-4872-9727-9b69c05b07b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:05.488486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daa70b-fa18-4872-9727-9b69c05b07b0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:05.598602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1313/2625] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:05 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:05.603045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77573c7-a1e6-43e0-a0fa-12d0ca93b30e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:05.615647 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77573c7-a1e6-43e0-a0fa-12d0ca93b30e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:05.620849 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fe64-f023-478b-9e06-a3676f29677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:05.621667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fe64-f023-478b-9e06-a3676f29677d admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:05.622124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fe64-f023-478b-9e06-a3676f29677d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:05.622553 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fe64-f023-478b-9e06-a3676f29677d admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:05.623426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998fe64-f023-478b-9e06-a3676f29677d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:05.625315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998fe64-f023-478b-9e06-a3676f29677d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:05.638501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1313/2626] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:05.643073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daa70b-fa18-4872-9727-9b69c05b07b0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:05.655546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daa70b-fa18-4872-9727-9b69c05b07b0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:05.662424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4f1a5-6cdf-4132-b352-aabdbb305117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:05.663343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4f1a5-6cdf-4132-b352-aabdbb305117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:05.663777 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4f1a5-6cdf-4132-b352-aabdbb305117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:05.664205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4f1a5-6cdf-4132-b352-aabdbb305117 admin admin] PATH_INFO: `/v3/projects/32b244e28be343b89394c5ea93d64f1c/users/026313c49f6343c2821231356bc443e6/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:05.684442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4f1a5-6cdf-4132-b352-aabdbb305117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b244e28be343b89394c5ea93d64f1c, user_id=026313c49f6343c2821231356bc443e6, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:05.687600 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4f1a5-6cdf-4132-b352-aabdbb305117 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:05.784753 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1314/2627] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:05 2022] PUT /identity/v3/projects/32b244e28be343b89394c5ea93d64f1c/users/026313c49f6343c2821231356bc443e6/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:05.790843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fe64-f023-478b-9e06-a3676f29677d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:05.826043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fe64-f023-478b-9e06-a3676f29677d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:05.895513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd70e-692f-4bec-a399-12bc8c14de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:05.896408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd70e-692f-4bec-a399-12bc8c14de9c admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:05.896690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd70e-692f-4bec-a399-12bc8c14de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:05.896962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd70e-692f-4bec-a399-12bc8c14de9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:05.897724 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fd70e-692f-4bec-a399-12bc8c14de9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:05.899340 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fd70e-692f-4bec-a399-12bc8c14de9c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:05.909526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1314/2628] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:05.913926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4f1a5-6cdf-4132-b352-aabdbb305117 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:05.925890 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4f1a5-6cdf-4132-b352-aabdbb305117 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:05.931760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:05.932467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:05.932751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:05.933025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] PATH_INFO: `/v3/projects/32b244e28be343b89394c5ea93d64f1c/users/026313c49f6343c2821231356bc443e6/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:05.935315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b244e28be343b89394c5ea93d64f1c, user_id=026313c49f6343c2821231356bc443e6, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:05.938227 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:05.963923 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1315/2629] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:05 2022] PUT /identity/v3/projects/32b244e28be343b89394c5ea93d64f1c/users/026313c49f6343c2821231356bc443e6/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:05.968192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5874a-46f8-4d5f-a80e-41c634af971c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:05.968768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5874a-46f8-4d5f-a80e-41c634af971c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:05.969207 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5874a-46f8-4d5f-a80e-41c634af971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:06.005511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5ea5874a-46f8-4d5f-a80e-41c634af971c None None] MFA Rules not processed for user `026313c49f6343c2821231356bc443e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:06.006988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5ea5874a-46f8-4d5f-a80e-41c634af971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:06.030823 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:06.089614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1315/2630] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:06.102151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:06.104062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:06.173742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55161435-6956-40ee-a06a-c96c219f8dae admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:06.181355 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:06.182201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:06.182539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:06.183159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:06.213527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:06.215098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:06.255956 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1316/2631] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:06.402296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5874a-46f8-4d5f-a80e-41c634af971c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:06.414325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5874a-46f8-4d5f-a80e-41c634af971c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:06.427047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917723e-fefc-4c2f-a3a5-b3b052e82688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:06.427771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917723e-fefc-4c2f-a3a5-b3b052e82688 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:06.428127 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917723e-fefc-4c2f-a3a5-b3b052e82688 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:06.428507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917723e-fefc-4c2f-a3a5-b3b052e82688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:06.488896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917723e-fefc-4c2f-a3a5-b3b052e82688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:06.490335 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917723e-fefc-4c2f-a3a5-b3b052e82688 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:06.508408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1316/2632] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:08.606647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:08.608189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:08.675249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e384ff-f9c6-4e5b-8be7-4947f63b8919 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:08.679724 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:08.680376 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:08.680659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:08.680931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] PATH_INFO: `/v3/users/d1bd70f21aed4b2bae45199a5901c00b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:08.682046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bd70f21aed4b2bae45199a5901c00b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:08.683965 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:08.697260 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:08.920422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bd70f21aed4b2bae45199a5901c00b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:08.921124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bd70f21aed4b2bae45199a5901c00b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.056242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bd70f21aed4b2bae45199a5901c00b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.066861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bd70f21aed4b2bae45199a5901c00b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.078468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-19437a56-7b0d-41af-b97e-66a5eca5f979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bd70f21aed4b2bae45199a5901c00b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.084527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1317/2633] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:08 2022] DELETE /identity/v3/users/d1bd70f21aed4b2bae45199a5901c00b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:09.367103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917723e-fefc-4c2f-a3a5-b3b052e82688 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:09.387404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917723e-fefc-4c2f-a3a5-b3b052e82688 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:09.456391 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:09.457339 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:09.457622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:09.457871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] PATH_INFO: `/v3/projects/6a431ef0f1e64b5dab74781f44c610ca` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:09.459164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a431ef0f1e64b5dab74781f44c610ca)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:09.461117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:09.596746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a431ef0f1e64b5dab74781f44c610ca', 'request_id': 'req-274558ac-0e52-4192-9678-a8469fc07fd3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.602887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a431ef0f1e64b5dab74781f44c610ca', 'request_id': 'req-274558ac-0e52-4192-9678-a8469fc07fd3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.606707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:09.608602 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a431ef0f1e64b5dab74781f44c610ca', 'request_id': 'req-274558ac-0e52-4192-9678-a8469fc07fd3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.683286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] The token cache is being invalidate because project 6a431ef0f1e64b5dab74781f44c610ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:09.683949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.684795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:09.686496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1317/2634] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:09 2022] DELETE /identity/v3/projects/6a431ef0f1e64b5dab74781f44c610ca => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:09.693430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111465a6-c4ed-4736-8b6c-af85e9a2e56f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:09.693968 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111465a6-c4ed-4736-8b6c-af85e9a2e56f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:09.694274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111465a6-c4ed-4736-8b6c-af85e9a2e56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:09.714965 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-111465a6-c4ed-4736-8b6c-af85e9a2e56f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:09.716191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-111465a6-c4ed-4736-8b6c-af85e9a2e56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:09.779416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:09.780902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:09.782087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1318/2635] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:09.791128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9cd5-390a-41ec-85e4-bb2a2dcd54a6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:09.791861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9cd5-390a-41ec-85e4-bb2a2dcd54a6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:09.791861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9cd5-390a-41ec-85e4-bb2a2dcd54a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:09.804580 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274558ac-0e52-4192-9678-a8469fc07fd3 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:09.810394 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:09.816201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:09.816201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:09.816201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] PATH_INFO: `/v3/users/f01782ed656a4c5a8db138c1a67ed41c` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:09.816201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01782ed656a4c5a8db138c1a67ed41c)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:09.816201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:09.819422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d9fd9cd5-390a-41ec-85e4-bb2a2dcd54a6 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:09.820749 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9fd9cd5-390a-41ec-85e4-bb2a2dcd54a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:09.830934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1319/2636] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:09.837473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd9cd5-390a-41ec-85e4-bb2a2dcd54a6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:09.849770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd9cd5-390a-41ec-85e4-bb2a2dcd54a6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:09.854742 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:09.857966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:09.857966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:09.857966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:09.857966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:09.857966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:09.858498 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:09.871975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1320/2637] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:30:09.876415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:09.886516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3c003-6a46-448c-a292-e6cf5fd3be9f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:09.891236 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:09.891825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:09.892741 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:09.893055 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:09.893807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:09.896089 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.020503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1321/2638] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:09 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:10.020503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:10.020503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:10.064525 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01782ed656a4c5a8db138c1a67ed41c'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.066679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:10.083368 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a92f71-aa4b-42ec-917b-a2a22ddd4ddf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:10.088254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:10.088903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.089181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.089453 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] PATH_INFO: `/v3/users/1bdf254b60fd4c229c9c1a698fad7520` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.090561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdf254b60fd4c229c9c1a698fad7520)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:10.092538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.140739 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01782ed656a4c5a8db138c1a67ed41c'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.141377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01782ed656a4c5a8db138c1a67ed41c'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.154682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01782ed656a4c5a8db138c1a67ed41c'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.155309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01782ed656a4c5a8db138c1a67ed41c'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.167776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1318/2639] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:09 2022] DELETE /identity/v3/users/f01782ed656a4c5a8db138c1a67ed41c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:10.168667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:10.169976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:10.233214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9305a4-e305-4824-850d-2ddbf1f4193e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:10.237978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a28e66-e20c-451c-839f-3921c8806279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:10.238573 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28e66-e20c-451c-839f-3921c8806279 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.238855 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28e66-e20c-451c-839f-3921c8806279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.239125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28e66-e20c-451c-839f-3921c8806279 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.239740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a28e66-e20c-451c-839f-3921c8806279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:10.241677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a28e66-e20c-451c-839f-3921c8806279 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.308743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdf254b60fd4c229c9c1a698fad7520'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.309395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdf254b60fd4c229c9c1a698fad7520'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.323357 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1319/2640] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:10 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:10.324651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937ef6a-9d61-46e6-ae0c-10861d6bad57 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.324936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937ef6a-9d61-46e6-ae0c-10861d6bad57 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.325210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937ef6a-9d61-46e6-ae0c-10861d6bad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.343524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c937ef6a-9d61-46e6-ae0c-10861d6bad57 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:10.344745 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c937ef6a-9d61-46e6-ae0c-10861d6bad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:10.352451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1320/2641] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:10.353171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937ef6a-9d61-46e6-ae0c-10861d6bad57 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:10.354345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c937ef6a-9d61-46e6-ae0c-10861d6bad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:10.366812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937ef6a-9d61-46e6-ae0c-10861d6bad57 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:10.371453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:10.380227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.380227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.380227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.380227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:10.380227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.385385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1321/2642] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:10.386171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:10.387813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:10.397688 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdf254b60fd4c229c9c1a698fad7520'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.405323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdf254b60fd4c229c9c1a698fad7520'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.417452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdf254b60fd4c229c9c1a698fad7520'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:10.421902 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=12,keystone:SELECT=83,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:10.424350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1322/2643] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:10 2022] DELETE /identity/v3/users/1bdf254b60fd4c229c9c1a698fad7520 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:10.424886 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:10.448337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e3c1-3cc0-43d8-85b6-fb28556a3e63 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:10.486536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d9a02-36ed-403a-8322-cde393f458be admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:10.491274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fa2bc-890a-4033-935b-2577785e3506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:10.491931 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa2bc-890a-4033-935b-2577785e3506 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.492212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa2bc-890a-4033-935b-2577785e3506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.492531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa2bc-890a-4033-935b-2577785e3506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.493181 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fa2bc-890a-4033-935b-2577785e3506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:10.494769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fa2bc-890a-4033-935b-2577785e3506 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.498440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d6f01-58a1-4a43-b7c6-43627f6d33f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:10.499046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d6f01-58a1-4a43-b7c6-43627f6d33f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.499345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d6f01-58a1-4a43-b7c6-43627f6d33f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.499616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d6f01-58a1-4a43-b7c6-43627f6d33f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.505134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1323/2644] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:10.505134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c53f9-67ef-43ec-8bb0-5007ae6b8b4e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.505134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c53f9-67ef-43ec-8bb0-5007ae6b8b4e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.505134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c53f9-67ef-43ec-8bb0-5007ae6b8b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.509819 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d6f01-58a1-4a43-b7c6-43627f6d33f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:10.511257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d6f01-58a1-4a43-b7c6-43627f6d33f5 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.521043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1322/2645] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:10.521881 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d6f01-58a1-4a43-b7c6-43627f6d33f5 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:10.526975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1c0c53f9-67ef-43ec-8bb0-5007ae6b8b4e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:10.528243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1c0c53f9-67ef-43ec-8bb0-5007ae6b8b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:10.531895 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d6f01-58a1-4a43-b7c6-43627f6d33f5 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:10.540123 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1324/2646] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:10.540297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19276b94-e493-46db-bf1c-abaad134fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:10.540297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19276b94-e493-46db-bf1c-abaad134fbee admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.540297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19276b94-e493-46db-bf1c-abaad134fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.540297 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19276b94-e493-46db-bf1c-abaad134fbee admin admin] PATH_INFO: `/v3/projects/0ab5c4bf14474562ab9bf63367169c9b/users/c2ae6ace5172469b907c069f482860f2/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.546522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c53f9-67ef-43ec-8bb0-5007ae6b8b4e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:10.548024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1c0c53f9-67ef-43ec-8bb0-5007ae6b8b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:10.561836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c53f9-67ef-43ec-8bb0-5007ae6b8b4e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:10.565183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19276b94-e493-46db-bf1c-abaad134fbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab5c4bf14474562ab9bf63367169c9b, user_id=c2ae6ace5172469b907c069f482860f2, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:10.566353 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f936bf-394c-4544-b3b3-eec0b40acd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:10.567124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f936bf-394c-4544-b3b3-eec0b40acd15 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.567611 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f936bf-394c-4544-b3b3-eec0b40acd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.567743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f936bf-394c-4544-b3b3-eec0b40acd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.568030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19276b94-e493-46db-bf1c-abaad134fbee admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.583116 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f936bf-394c-4544-b3b3-eec0b40acd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:10.584616 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f936bf-394c-4544-b3b3-eec0b40acd15 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.598042 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1325/2647] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:10.673302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1323/2648] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:10 2022] PUT /identity/v3/projects/0ab5c4bf14474562ab9bf63367169c9b/users/c2ae6ace5172469b907c069f482860f2/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:10.683817 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72e892-70d3-4b11-89c4-1e4770f927d2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.684101 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72e892-70d3-4b11-89c4-1e4770f927d2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.684424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72e892-70d3-4b11-89c4-1e4770f927d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.714595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ec72e892-70d3-4b11-89c4-1e4770f927d2 None None] MFA Rules not processed for user `c2ae6ace5172469b907c069f482860f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:10.715800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ec72e892-70d3-4b11-89c4-1e4770f927d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:10.746584 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:10.807331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1326/2649] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:10.808269 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19276b94-e493-46db-bf1c-abaad134fbee admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:10.896251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19276b94-e493-46db-bf1c-abaad134fbee admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:10.901998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:10.902592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:10.902865 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:10.903137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:10.903777 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:10.905748 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:10.995914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1324/2650] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:10 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:10.997132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72e892-70d3-4b11-89c4-1e4770f927d2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:11.007743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72e892-70d3-4b11-89c4-1e4770f927d2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:11.026588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:11.029317 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:11.078895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:11.078895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:11.078895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:11.078895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:11.079389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:11.079389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:11.084552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:11.098711 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8c5af-b408-4e20-ad8b-c8ab5c16150a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:11.103448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:11.104074 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:11.104372 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:11.104643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] PATH_INFO: `/v3/projects/16d5e2c7494641b7b2a388fe29d38abd` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:11.105978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d5e2c7494641b7b2a388fe29d38abd)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:11.107905 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:11.152592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1327/2651] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:10 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:11.153444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:11.155025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:11.167442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ea969-fe60-4ae4-a8a9-15dad1851999 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:11.172015 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:11.172663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:11.172945 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:11.173235 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] PATH_INFO: `/v3/projects/509759dadfbf463b88ea0b23e6e63e8a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:11.174650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=509759dadfbf463b88ea0b23e6e63e8a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:11.176598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:11.231654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d5e2c7494641b7b2a388fe29d38abd', 'request_id': 'req-5b673c89-7147-4e53-aecf-b8abfa49ddb8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.237944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d5e2c7494641b7b2a388fe29d38abd', 'request_id': 'req-5b673c89-7147-4e53-aecf-b8abfa49ddb8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.243675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d5e2c7494641b7b2a388fe29d38abd', 'request_id': 'req-5b673c89-7147-4e53-aecf-b8abfa49ddb8'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.411335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509759dadfbf463b88ea0b23e6e63e8a', 'request_id': 'req-40b37854-9b0d-444c-816b-3cbcdd5fa65e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.411335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509759dadfbf463b88ea0b23e6e63e8a', 'request_id': 'req-40b37854-9b0d-444c-816b-3cbcdd5fa65e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.411335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509759dadfbf463b88ea0b23e6e63e8a', 'request_id': 'req-40b37854-9b0d-444c-816b-3cbcdd5fa65e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.557775 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] The token cache is being invalidate because project 16d5e2c7494641b7b2a388fe29d38abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:11.565240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.565240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.565240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1325/2652] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:11 2022] DELETE /identity/v3/projects/16d5e2c7494641b7b2a388fe29d38abd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:11.565240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:11.565240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:11.627738 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673c89-7147-4e53-aecf-b8abfa49ddb8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:11.672383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] The token cache is being invalidate because project 509759dadfbf463b88ea0b23e6e63e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:11.672618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.674003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.676031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1328/2653] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:11 2022] DELETE /identity/v3/projects/509759dadfbf463b88ea0b23e6e63e8a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:11.676630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:11.678018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:11.685281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:11.685886 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:11.686160 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:11.686426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:11.687067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:11.688712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:11.702209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1326/2654] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:11.702209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:11.702209 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:11.713972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02469d-7a0a-4180-8489-b6c9cceb4e47 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:11.718856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:11.719472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:11.719771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:11.720041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] PATH_INFO: `/v3/users/026313c49f6343c2821231356bc443e6` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:11.722006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026313c49f6343c2821231356bc443e6)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:11.723887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:11.725895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:11.744618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b37854-9b0d-444c-816b-3cbcdd5fa65e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:11.750121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:11.750121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:11.750471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:11.750800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] PATH_INFO: `/v3/users/488446a7e8ab4257ba4096997c54f543` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:11.752173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=488446a7e8ab4257ba4096997c54f543)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:11.754141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:11.962042 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026313c49f6343c2821231356bc443e6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.974320 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:11.987155 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488446a7e8ab4257ba4096997c54f543'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:11.987914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488446a7e8ab4257ba4096997c54f543'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.053722 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026313c49f6343c2821231356bc443e6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.054484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026313c49f6343c2821231356bc443e6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.068210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026313c49f6343c2821231356bc443e6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.068915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026313c49f6343c2821231356bc443e6'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.081211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1327/2655] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:11 2022] DELETE /identity/v3/users/026313c49f6343c2821231356bc443e6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:12.082137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:12.083500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:12.147750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83444680-f3c7-4696-8d66-0fcd4011f300 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:12.151998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488446a7e8ab4257ba4096997c54f543'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.152524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d9830-eb9c-4164-acc4-08a169d664cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:12.153803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9830-eb9c-4164-acc4-08a169d664cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.154091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9830-eb9c-4164-acc4-08a169d664cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.154362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9830-eb9c-4164-acc4-08a169d664cf admin admin] PATH_INFO: `/v3/projects/cea07d6a4e4849d9b44d104c8f876f8c/users/9ec0e27b56b64b9695b61aa444ff8a82/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.160773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488446a7e8ab4257ba4096997c54f543'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.170001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d9830-eb9c-4164-acc4-08a169d664cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea07d6a4e4849d9b44d104c8f876f8c, user_id=9ec0e27b56b64b9695b61aa444ff8a82, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:12.172787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d9830-eb9c-4164-acc4-08a169d664cf admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:12.175007 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488446a7e8ab4257ba4096997c54f543'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.181147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1329/2656] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:11 2022] DELETE /identity/v3/users/488446a7e8ab4257ba4096997c54f543 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:12.226337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1328/2657] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:12 2022] PUT /identity/v3/projects/cea07d6a4e4849d9b44d104c8f876f8c/users/9ec0e27b56b64b9695b61aa444ff8a82/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:12.230444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:12.231882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:12.298412 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e34a0d-720f-4235-a2c7-24cae5268913 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:12.359009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eefc26-6fff-4cda-ac18-c11517bcd80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:12.359781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eefc26-6fff-4cda-ac18-c11517bcd80d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.360274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eefc26-6fff-4cda-ac18-c11517bcd80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.360582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eefc26-6fff-4cda-ac18-c11517bcd80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.361270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eefc26-6fff-4cda-ac18-c11517bcd80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:12.362893 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eefc26-6fff-4cda-ac18-c11517bcd80d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:12.373280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1330/2658] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:12.378128 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d9830-eb9c-4164-acc4-08a169d664cf admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:12.388365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d9830-eb9c-4164-acc4-08a169d664cf admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:12.393102 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:12.393758 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.394038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.394315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] PATH_INFO: `/v3/projects/cea07d6a4e4849d9b44d104c8f876f8c/users/9ec0e27b56b64b9695b61aa444ff8a82/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.396567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea07d6a4e4849d9b44d104c8f876f8c, user_id=9ec0e27b56b64b9695b61aa444ff8a82, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:12.399217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:12.410513 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1329/2659] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:12 2022] PUT /identity/v3/projects/cea07d6a4e4849d9b44d104c8f876f8c/users/9ec0e27b56b64b9695b61aa444ff8a82/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:12.425575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f183e3-e9c0-46de-bc9c-57c0e99d67cf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.425575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f183e3-e9c0-46de-bc9c-57c0e99d67cf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.425575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f183e3-e9c0-46de-bc9c-57c0e99d67cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.465184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-56f183e3-e9c0-46de-bc9c-57c0e99d67cf None None] MFA Rules not processed for user `9ec0e27b56b64b9695b61aa444ff8a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:12.465184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-56f183e3-e9c0-46de-bc9c-57c0e99d67cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:12.484679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:12.533743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1331/2660] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:12.545044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:12.546794 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:12.554778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f183e3-e9c0-46de-bc9c-57c0e99d67cf None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:12.562283 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-56f183e3-e9c0-46de-bc9c-57c0e99d67cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:12.616882 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484407b-4380-4930-9581-35dc9e081aea admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:12.621133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:12.621742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.622017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.622287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.627158 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f183e3-e9c0-46de-bc9c-57c0e99d67cf None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:12.631673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:12.632137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:12.632357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.632599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.632869 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] PATH_INFO: `/v3/projects/32b244e28be343b89394c5ea93d64f1c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.633592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:12.633990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b244e28be343b89394c5ea93d64f1c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:12.635858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:12.645495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1330/2661] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:12.674549 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:12.676227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:12.690618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ce2f-49ff-474e-91da-633096c614c0 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:12.706500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:12.706500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.706500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.706500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] PATH_INFO: `/v3/projects/3ec0b79555244de880bb9ca6d72a53d3` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.708471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec0b79555244de880bb9ca6d72a53d3)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:12.710494 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:12.713265 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:12.764149 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b244e28be343b89394c5ea93d64f1c', 'request_id': 'req-9f952a07-ffcd-4b42-a54f-7a074022fd67'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.771088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b244e28be343b89394c5ea93d64f1c', 'request_id': 'req-9f952a07-ffcd-4b42-a54f-7a074022fd67'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.778118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b244e28be343b89394c5ea93d64f1c', 'request_id': 'req-9f952a07-ffcd-4b42-a54f-7a074022fd67'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.845125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec0b79555244de880bb9ca6d72a53d3', 'request_id': 'req-13f1a332-a5fe-4852-a7a0-c56137098d1a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.852177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec0b79555244de880bb9ca6d72a53d3', 'request_id': 'req-13f1a332-a5fe-4852-a7a0-c56137098d1a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.857743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec0b79555244de880bb9ca6d72a53d3', 'request_id': 'req-13f1a332-a5fe-4852-a7a0-c56137098d1a'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.872788 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] The token cache is being invalidate because project 32b244e28be343b89394c5ea93d64f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:12.872955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.873513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.875007 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1332/2662] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:12 2022] DELETE /identity/v3/projects/32b244e28be343b89394c5ea93d64f1c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:12.877641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:12.877641 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:12.937571 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f952a07-ffcd-4b42-a54f-7a074022fd67 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:12.987187 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] The token cache is being invalidate because project 3ec0b79555244de880bb9ca6d72a53d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:12.987604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.988394 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-13f1a332-a5fe-4852-a7a0-c56137098d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:12.989954 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1331/2663] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:12 2022] DELETE /identity/v3/projects/3ec0b79555244de880bb9ca6d72a53d3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:12.993349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50bff-c053-425e-8ded-14de9b9cc1ca None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.993349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50bff-c053-425e-8ded-14de9b9cc1ca None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.993349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc50bff-c053-425e-8ded-14de9b9cc1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.995100 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34f9da-417c-4b16-9e46-62aba6ed5aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:12.995994 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34f9da-417c-4b16-9e46-62aba6ed5aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:12.996470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34f9da-417c-4b16-9e46-62aba6ed5aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:12.996844 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34f9da-417c-4b16-9e46-62aba6ed5aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:12.998500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d34f9da-417c-4b16-9e46-62aba6ed5aa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:13.012814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-adc50bff-c053-425e-8ded-14de9b9cc1ca None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:13.017729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-adc50bff-c053-425e-8ded-14de9b9cc1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:13.061946 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34f9da-417c-4b16-9e46-62aba6ed5aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.063440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34f9da-417c-4b16-9e46-62aba6ed5aa6 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.077527 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:13.112400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1332/2665] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:13.112522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1333/2665] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:13.112638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611c64-3442-4c55-bdfd-596b2c3c1b3f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.112638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611c64-3442-4c55-bdfd-596b2c3c1b3f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.112638 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc611c64-3442-4c55-bdfd-596b2c3c1b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.112911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845db066-2b74-4bab-a2f9-029f4f362978 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.112911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845db066-2b74-4bab-a2f9-029f4f362978 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.112911 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845db066-2b74-4bab-a2f9-029f4f362978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.113180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-dc611c64-3442-4c55-bdfd-596b2c3c1b3f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:13.113180 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-dc611c64-3442-4c55-bdfd-596b2c3c1b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:13.139398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1333/2666] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:13.142172 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663928-b29b-48ef-8818-50532da18949 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.148719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663928-b29b-48ef-8818-50532da18949 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.148719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663928-b29b-48ef-8818-50532da18949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.148943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-845db066-2b74-4bab-a2f9-029f4f362978 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:13.148943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-845db066-2b74-4bab-a2f9-029f4f362978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:13.183429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-63663928-b29b-48ef-8818-50532da18949 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:13.185045 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-63663928-b29b-48ef-8818-50532da18949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:13.191790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1334/2667] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:13.192735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845db066-2b74-4bab-a2f9-029f4f362978 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.200658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1334/2668] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:13.209949 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63663928-b29b-48ef-8818-50532da18949 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.212349 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845db066-2b74-4bab-a2f9-029f4f362978 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.220017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.221966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.221966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.221966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.223245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:13.223832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.225633 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.225767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63663928-b29b-48ef-8818-50532da18949 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.241875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.241875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.241875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.241875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.242629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:13.244291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.245534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.250216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1335/2669] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:13.255654 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.272740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1335/2670] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:13.278103 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.284985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5771be1-2b83-45cc-b4e8-483b6284c09c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.296568 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a382-27a1-4ea5-a1b4-62671142f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.297620 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a382-27a1-4ea5-a1b4-62671142f3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.299123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586395f-4f06-4618-945e-ab6f0104f915 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.300279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a382-27a1-4ea5-a1b4-62671142f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.301840 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a382-27a1-4ea5-a1b4-62671142f3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.302668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a382-27a1-4ea5-a1b4-62671142f3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.305289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86170ce8-dd83-4681-aacb-3707d3418be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.306162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170ce8-dd83-4681-aacb-3707d3418be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.306538 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170ce8-dd83-4681-aacb-3707d3418be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.307038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86170ce8-dd83-4681-aacb-3707d3418be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.308009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86170ce8-dd83-4681-aacb-3707d3418be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.309416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a382-27a1-4ea5-a1b4-62671142f3a5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.310168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86170ce8-dd83-4681-aacb-3707d3418be7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.477865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1336/2672] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:13.484242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1336/2672] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/projects => generated 389 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:13.489787 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a382-27a1-4ea5-a1b4-62671142f3a5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.490067 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86170ce8-dd83-4681-aacb-3707d3418be7 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.542201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:13.544013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:13.554977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a382-27a1-4ea5-a1b4-62671142f3a5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.558672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86170ce8-dd83-4681-aacb-3707d3418be7 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.560125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ea54-141e-448b-8689-11cb2333524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.560730 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ea54-141e-448b-8689-11cb2333524f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.561014 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ea54-141e-448b-8689-11cb2333524f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.561288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ea54-141e-448b-8689-11cb2333524f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.561914 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ea54-141e-448b-8689-11cb2333524f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.564267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0555c6-163c-4049-a31a-085c4b1a1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.564536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ea54-141e-448b-8689-11cb2333524f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.565101 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0555c6-163c-4049-a31a-085c4b1a1e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.565447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0555c6-163c-4049-a31a-085c4b1a1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.565784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0555c6-163c-4049-a31a-085c4b1a1e5b admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.566473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0555c6-163c-4049-a31a-085c4b1a1e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.568729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0555c6-163c-4049-a31a-085c4b1a1e5b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.665986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1337/2673] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:13.670978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1337/2674] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:13.671567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ea54-141e-448b-8689-11cb2333524f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.671662 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0555c6-163c-4049-a31a-085c4b1a1e5b admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.679038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0555c6-163c-4049-a31a-085c4b1a1e5b admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.679437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ea54-141e-448b-8689-11cb2333524f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.684068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac8bad-ca49-4a21-97ae-c8f190a8c9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.684703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac8bad-ca49-4a21-97ae-c8f190a8c9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.684985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac8bad-ca49-4a21-97ae-c8f190a8c9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.685262 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac8bad-ca49-4a21-97ae-c8f190a8c9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.685783 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08096e-e511-4845-aee8-c12571db8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.685921 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac8bad-ca49-4a21-97ae-c8f190a8c9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.686390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08096e-e511-4845-aee8-c12571db8f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.686677 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08096e-e511-4845-aee8-c12571db8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.686955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08096e-e511-4845-aee8-c12571db8f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.687547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac8bad-ca49-4a21-97ae-c8f190a8c9d1 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.687680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08096e-e511-4845-aee8-c12571db8f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.689961 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08096e-e511-4845-aee8-c12571db8f7d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.701091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1338/2675] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:13.703441 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1338/2676] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:13.705281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac8bad-ca49-4a21-97ae-c8f190a8c9d1 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.705953 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08096e-e511-4845-aee8-c12571db8f7d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.718128 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08096e-e511-4845-aee8-c12571db8f7d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.718644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac8bad-ca49-4a21-97ae-c8f190a8c9d1 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.723467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1964e0-6e08-4b82-b4c6-7c13e34374bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.728550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bddf38-8d6d-49e0-9084-44f7852a40f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.728704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1964e0-6e08-4b82-b4c6-7c13e34374bf admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.728813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bddf38-8d6d-49e0-9084-44f7852a40f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.728943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1964e0-6e08-4b82-b4c6-7c13e34374bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.729047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bddf38-8d6d-49e0-9084-44f7852a40f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.729168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1964e0-6e08-4b82-b4c6-7c13e34374bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.729267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bddf38-8d6d-49e0-9084-44f7852a40f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.729356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1964e0-6e08-4b82-b4c6-7c13e34374bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.729449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bddf38-8d6d-49e0-9084-44f7852a40f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.729549 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1964e0-6e08-4b82-b4c6-7c13e34374bf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.729653 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bddf38-8d6d-49e0-9084-44f7852a40f7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.742691 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1339/2677] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:13.742916 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1339/2678] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:13.744074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1964e0-6e08-4b82-b4c6-7c13e34374bf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.745143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bddf38-8d6d-49e0-9084-44f7852a40f7 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:13.757016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bddf38-8d6d-49e0-9084-44f7852a40f7 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.762047 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1964e0-6e08-4b82-b4c6-7c13e34374bf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:13.762173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6834360-c69f-45b1-a340-763f13bf3573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.762903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6834360-c69f-45b1-a340-763f13bf3573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.763189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6834360-c69f-45b1-a340-763f13bf3573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.763464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6834360-c69f-45b1-a340-763f13bf3573 admin admin] PATH_INFO: `/v3/projects/f2a465d324a2416dae6b1f4815a08577/users/98cfd61c19f44e1bb8eaa9478bf67e3d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.768064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e939dae-ee3b-46f3-94ac-3a7dc31b0f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:13.769470 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e939dae-ee3b-46f3-94ac-3a7dc31b0f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.770079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e939dae-ee3b-46f3-94ac-3a7dc31b0f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.770430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e939dae-ee3b-46f3-94ac-3a7dc31b0f9a admin admin] PATH_INFO: `/v3/projects/287e34ba5dad4bffb314c948ffdaf405/users/7af08733b4c846aea7d5efaa3a91034d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.786974 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e939dae-ee3b-46f3-94ac-3a7dc31b0f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=287e34ba5dad4bffb314c948ffdaf405, user_id=7af08733b4c846aea7d5efaa3a91034d, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.788620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6834360-c69f-45b1-a340-763f13bf3573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a465d324a2416dae6b1f4815a08577, user_id=98cfd61c19f44e1bb8eaa9478bf67e3d, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:13.790156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e939dae-ee3b-46f3-94ac-3a7dc31b0f9a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.792506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6834360-c69f-45b1-a340-763f13bf3573 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:13.884778 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1340/2679] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:13 2022] PUT /identity/v3/projects/287e34ba5dad4bffb314c948ffdaf405/users/7af08733b4c846aea7d5efaa3a91034d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:13.886937 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39af3-f9ee-426b-af27-d13355613d59 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.887201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39af3-f9ee-426b-af27-d13355613d59 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.887694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39af3-f9ee-426b-af27-d13355613d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.889901 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1340/2680] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:13 2022] PUT /identity/v3/projects/f2a465d324a2416dae6b1f4815a08577/users/98cfd61c19f44e1bb8eaa9478bf67e3d/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:13.901597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81589-243e-4b43-9c00-582d2d4af250 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:13.901880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81589-243e-4b43-9c00-582d2d4af250 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:13.902149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81589-243e-4b43-9c00-582d2d4af250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:13.928022 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-40f39af3-f9ee-426b-af27-d13355613d59 None None] MFA Rules not processed for user `7af08733b4c846aea7d5efaa3a91034d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:13.929266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-40f39af3-f9ee-426b-af27-d13355613d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:13.932878 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-2fc81589-243e-4b43-9c00-582d2d4af250 None None] MFA Rules not processed for user `98cfd61c19f44e1bb8eaa9478bf67e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:13.934130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-2fc81589-243e-4b43-9c00-582d2d4af250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:13.999617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1341/2681] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:14.001112 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1341/2682] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:14.004648 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39af3-f9ee-426b-af27-d13355613d59 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.007959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc81589-243e-4b43-9c00-582d2d4af250 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.080370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc81589-243e-4b43-9c00-582d2d4af250 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.081031 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39af3-f9ee-426b-af27-d13355613d59 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.085030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28f87a-7837-47f9-958c-bc085966dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.085642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28f87a-7837-47f9-958c-bc085966dee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.085769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d241d-d127-428d-8e11-12c0233caaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.085925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28f87a-7837-47f9-958c-bc085966dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.086210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28f87a-7837-47f9-958c-bc085966dee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.086320 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d241d-d127-428d-8e11-12c0233caaea admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.086591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d241d-d127-428d-8e11-12c0233caaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.086818 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28f87a-7837-47f9-958c-bc085966dee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.086954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d241d-d127-428d-8e11-12c0233caaea admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.087630 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d241d-d127-428d-8e11-12c0233caaea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.089474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28f87a-7837-47f9-958c-bc085966dee2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.089762 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d241d-d127-428d-8e11-12c0233caaea admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.214286 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1342/2683] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:14 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:14.215597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28f87a-7837-47f9-958c-bc085966dee2 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.220126 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:14.244352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1342/2684] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:14 2022] POST /identity/v3/projects => generated 389 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:14.248433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d241d-d127-428d-8e11-12c0233caaea admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.266137 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:14.285640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28f87a-7837-47f9-958c-bc085966dee2 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.331928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d241d-d127-428d-8e11-12c0233caaea admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.337199 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1a31-8f19-42d2-83f0-381a6d5b8c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.337811 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1a31-8f19-42d2-83f0-381a6d5b8c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.338085 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1a31-8f19-42d2-83f0-381a6d5b8c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.338359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1a31-8f19-42d2-83f0-381a6d5b8c47 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.339475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1a31-8f19-42d2-83f0-381a6d5b8c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.341360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1a31-8f19-42d2-83f0-381a6d5b8c47 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.348430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472a096-3e9a-44cd-ae12-d1b9d87c8ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.351540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472a096-3e9a-44cd-ae12-d1b9d87c8ace admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.351540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472a096-3e9a-44cd-ae12-d1b9d87c8ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.351540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472a096-3e9a-44cd-ae12-d1b9d87c8ace admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.351540 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472a096-3e9a-44cd-ae12-d1b9d87c8ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.352454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472a096-3e9a-44cd-ae12-d1b9d87c8ace admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.415338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1343/2685] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:14 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:14.419254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1a31-8f19-42d2-83f0-381a6d5b8c47 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.429366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1a31-8f19-42d2-83f0-381a6d5b8c47 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.433920 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e715d86-0762-4688-9707-a2b4a16ecc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.434506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715d86-0762-4688-9707-a2b4a16ecc9e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.434781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715d86-0762-4688-9707-a2b4a16ecc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.435330 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715d86-0762-4688-9707-a2b4a16ecc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.436013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e715d86-0762-4688-9707-a2b4a16ecc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.437607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e715d86-0762-4688-9707-a2b4a16ecc9e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.437972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1343/2686] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:14 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:14.442614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472a096-3e9a-44cd-ae12-d1b9d87c8ace admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.451084 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1344/2687] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:14.452034 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e715d86-0762-4688-9707-a2b4a16ecc9e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.452799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472a096-3e9a-44cd-ae12-d1b9d87c8ace admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.457464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc6afd-8781-4c0f-8be1-4c2f5525c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.458068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6afd-8781-4c0f-8be1-4c2f5525c3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.458349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6afd-8781-4c0f-8be1-4c2f5525c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.458620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc6afd-8781-4c0f-8be1-4c2f5525c3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.459299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc6afd-8781-4c0f-8be1-4c2f5525c3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.461225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc6afd-8781-4c0f-8be1-4c2f5525c3cc admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.461770 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e715d86-0762-4688-9707-a2b4a16ecc9e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.467325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7b3f5-987d-49af-a88d-9ca3320305f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.468671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7b3f5-987d-49af-a88d-9ca3320305f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.468671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7b3f5-987d-49af-a88d-9ca3320305f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.468671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7b3f5-987d-49af-a88d-9ca3320305f8 admin admin] PATH_INFO: `/v3/projects/5ec26f34d37a4353889130fa0051ae18/users/f11de22a9a9d40f49faf45a3a1e23b2b/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.475535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1344/2688] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:14.476873 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc6afd-8781-4c0f-8be1-4c2f5525c3cc admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.485083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7b3f5-987d-49af-a88d-9ca3320305f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec26f34d37a4353889130fa0051ae18, user_id=f11de22a9a9d40f49faf45a3a1e23b2b, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.487427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc6afd-8781-4c0f-8be1-4c2f5525c3cc admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.488868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7b3f5-987d-49af-a88d-9ca3320305f8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.492201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f8025-ecf2-4024-b899-24d4afe151f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.494973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f8025-ecf2-4024-b899-24d4afe151f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.494973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f8025-ecf2-4024-b899-24d4afe151f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.494973 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f8025-ecf2-4024-b899-24d4afe151f6 admin admin] PATH_INFO: `/v3/projects/ea465b3ccf4b4512a745655725030bf4/users/559b1d63f1ac4c5496fe6b358c638fb0/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.508430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f8025-ecf2-4024-b899-24d4afe151f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea465b3ccf4b4512a745655725030bf4, user_id=559b1d63f1ac4c5496fe6b358c638fb0, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.511099 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f8025-ecf2-4024-b899-24d4afe151f6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.562238 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1345/2689] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:14 2022] PUT /identity/v3/projects/5ec26f34d37a4353889130fa0051ae18/users/f11de22a9a9d40f49faf45a3a1e23b2b/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:14.566366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7b3f5-987d-49af-a88d-9ca3320305f8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.620831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1345/2690] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:14 2022] PUT /identity/v3/projects/ea465b3ccf4b4512a745655725030bf4/users/559b1d63f1ac4c5496fe6b358c638fb0/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:14.624920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f8025-ecf2-4024-b899-24d4afe151f6 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.626707 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7b3f5-987d-49af-a88d-9ca3320305f8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.687385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d188570-5fd8-48e8-b8c2-6461bb39ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.688337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d188570-5fd8-48e8-b8c2-6461bb39ba5f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.688624 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d188570-5fd8-48e8-b8c2-6461bb39ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.689030 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d188570-5fd8-48e8-b8c2-6461bb39ba5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.689853 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d188570-5fd8-48e8-b8c2-6461bb39ba5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.689978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f8025-ecf2-4024-b899-24d4afe151f6 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.691515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d188570-5fd8-48e8-b8c2-6461bb39ba5f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.694948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20073701-49eb-4af6-949c-eab222fc2285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.696226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20073701-49eb-4af6-949c-eab222fc2285 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.696226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20073701-49eb-4af6-949c-eab222fc2285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.696226 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20073701-49eb-4af6-949c-eab222fc2285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.696728 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20073701-49eb-4af6-949c-eab222fc2285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.698313 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20073701-49eb-4af6-949c-eab222fc2285 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.701788 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1346/2691] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:14.703768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:14.705748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d188570-5fd8-48e8-b8c2-6461bb39ba5f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.709282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1346/2692] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:14.713283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20073701-49eb-4af6-949c-eab222fc2285 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.717264 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d188570-5fd8-48e8-b8c2-6461bb39ba5f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.722581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660ee52-1b71-4f59-ae57-4134816dd592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.723241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ee52-1b71-4f59-ae57-4134816dd592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.724874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ee52-1b71-4f59-ae57-4134816dd592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.724874 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ee52-1b71-4f59-ae57-4134816dd592 admin admin] PATH_INFO: `/v3/projects/5ec26f34d37a4353889130fa0051ae18/users/f11de22a9a9d40f49faf45a3a1e23b2b/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.725125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20073701-49eb-4af6-949c-eab222fc2285 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.725785 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660ee52-1b71-4f59-ae57-4134816dd592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec26f34d37a4353889130fa0051ae18, user_id=f11de22a9a9d40f49faf45a3a1e23b2b, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.728668 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660ee52-1b71-4f59-ae57-4134816dd592 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.730249 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0526683-a64e-4495-a492-0b718f8a53d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.730963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:14.731247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0526683-a64e-4495-a492-0b718f8a53d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.731733 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0526683-a64e-4495-a492-0b718f8a53d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.731919 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0526683-a64e-4495-a492-0b718f8a53d3 admin admin] PATH_INFO: `/v3/projects/ea465b3ccf4b4512a745655725030bf4/users/559b1d63f1ac4c5496fe6b358c638fb0/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.734388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0526683-a64e-4495-a492-0b718f8a53d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea465b3ccf4b4512a745655725030bf4, user_id=559b1d63f1ac4c5496fe6b358c638fb0, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.737889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0526683-a64e-4495-a492-0b718f8a53d3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.741259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1347/2693] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:14 2022] PUT /identity/v3/projects/5ec26f34d37a4353889130fa0051ae18/users/f11de22a9a9d40f49faf45a3a1e23b2b/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:14.749115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1347/2694] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:14 2022] PUT /identity/v3/projects/ea465b3ccf4b4512a745655725030bf4/users/559b1d63f1ac4c5496fe6b358c638fb0/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:14.751801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fcd85-c61b-45ed-8589-307060d22fa1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.752162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fcd85-c61b-45ed-8589-307060d22fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.752503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fcd85-c61b-45ed-8589-307060d22fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.761110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497f92-7462-4e0d-bb87-5e01050c678d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.761581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497f92-7462-4e0d-bb87-5e01050c678d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.761861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497f92-7462-4e0d-bb87-5e01050c678d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.784889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8e8fcd85-c61b-45ed-8589-307060d22fa1 None None] MFA Rules not processed for user `f11de22a9a9d40f49faf45a3a1e23b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:14.786332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8e8fcd85-c61b-45ed-8589-307060d22fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:14.792665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-79497f92-7462-4e0d-bb87-5e01050c678d None None] MFA Rules not processed for user `559b1d63f1ac4c5496fe6b358c638fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:14.793852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-79497f92-7462-4e0d-bb87-5e01050c678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:14.857105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1348/2695] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:14.868846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fcd85-c61b-45ed-8589-307060d22fa1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.874471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1348/2696] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:14.874606 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8e8fcd85-c61b-45ed-8589-307060d22fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:14.883477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497f92-7462-4e0d-bb87-5e01050c678d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:14.885250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-79497f92-7462-4e0d-bb87-5e01050c678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:14.928676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fcd85-c61b-45ed-8589-307060d22fa1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.932224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a09f5c-e546-469d-871b-c06b71e3a768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.932858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a09f5c-e546-469d-871b-c06b71e3a768 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.933190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a09f5c-e546-469d-871b-c06b71e3a768 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.933578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a09f5c-e546-469d-871b-c06b71e3a768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.942842 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497f92-7462-4e0d-bb87-5e01050c678d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:14.943045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a09f5c-e546-469d-871b-c06b71e3a768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.944531 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a09f5c-e546-469d-871b-c06b71e3a768 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.946820 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d713-b64d-487a-9a34-ea1b5c8b6ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:14.947416 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d713-b64d-487a-9a34-ea1b5c8b6ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:14.947697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d713-b64d-487a-9a34-ea1b5c8b6ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:14.947972 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295d713-b64d-487a-9a34-ea1b5c8b6ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:14.955559 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1349/2697] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:14.958614 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295d713-b64d-487a-9a34-ea1b5c8b6ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:14.966369 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295d713-b64d-487a-9a34-ea1b5c8b6ac3 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:14.970924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1349/2698] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:15.189927 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a09f5c-e546-469d-871b-c06b71e3a768 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:15.197903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a09f5c-e546-469d-871b-c06b71e3a768 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:15.201740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff122bf8-e5ec-468c-b9b8-ee41a4c20af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:15.202413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff122bf8-e5ec-468c-b9b8-ee41a4c20af6 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:15.202798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff122bf8-e5ec-468c-b9b8-ee41a4c20af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:15.203267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff122bf8-e5ec-468c-b9b8-ee41a4c20af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:15.248349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d713-b64d-487a-9a34-ea1b5c8b6ac3 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:15.286592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff122bf8-e5ec-468c-b9b8-ee41a4c20af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:15.288254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff122bf8-e5ec-468c-b9b8-ee41a4c20af6 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:15.298037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1350/2699] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:15.344415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295d713-b64d-487a-9a34-ea1b5c8b6ac3 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:15.350288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:15.350984 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:15.351163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:15.351433 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] PATH_INFO: `/v3/users/7af08733b4c846aea7d5efaa3a91034d` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:15.352767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af08733b4c846aea7d5efaa3a91034d)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:15.354692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:15.377190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:15.598305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af08733b4c846aea7d5efaa3a91034d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:15.690129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af08733b4c846aea7d5efaa3a91034d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:15.690994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af08733b4c846aea7d5efaa3a91034d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:15.707300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af08733b4c846aea7d5efaa3a91034d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:15.708033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af08733b4c846aea7d5efaa3a91034d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:15.722524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1350/2700] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:15 2022] DELETE /identity/v3/users/7af08733b4c846aea7d5efaa3a91034d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:15.727104 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45909db8-6833-45c1-807b-282257be59ca None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:15.727393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45909db8-6833-45c1-807b-282257be59ca None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:15.727799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45909db8-6833-45c1-807b-282257be59ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:15.747410 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-45909db8-6833-45c1-807b-282257be59ca None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:15.748659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-45909db8-6833-45c1-807b-282257be59ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:15.763490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:15.830476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1351/2701] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:15.840178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:15.841640 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:15.900279 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086252-d32f-442a-b73b-2aba0e1210f6 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:15.903822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b64623-a698-437e-9492-3fbd08df7b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:15.904452 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64623-a698-437e-9492-3fbd08df7b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:15.904798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64623-a698-437e-9492-3fbd08df7b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:15.904999 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b64623-a698-437e-9492-3fbd08df7b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:15.914690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b64623-a698-437e-9492-3fbd08df7b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:15.916468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b64623-a698-437e-9492-3fbd08df7b98 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:15.926323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1351/2702] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:15.955256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45909db8-6833-45c1-807b-282257be59ca None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:15.957008 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-45909db8-6833-45c1-807b-282257be59ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:15.969297 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45909db8-6833-45c1-807b-282257be59ca None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:15.975389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:15.976121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:15.976525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:15.976863 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] PATH_INFO: `/v3/users/98cfd61c19f44e1bb8eaa9478bf67e3d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:15.978358 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98cfd61c19f44e1bb8eaa9478bf67e3d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:15.980259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:16.217765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98cfd61c19f44e1bb8eaa9478bf67e3d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.218908 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98cfd61c19f44e1bb8eaa9478bf67e3d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.289359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98cfd61c19f44e1bb8eaa9478bf67e3d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.297390 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98cfd61c19f44e1bb8eaa9478bf67e3d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.312520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98cfd61c19f44e1bb8eaa9478bf67e3d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.325127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1352/2703] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:15 2022] DELETE /identity/v3/users/98cfd61c19f44e1bb8eaa9478bf67e3d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:16.330957 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6277c-eff9-46b3-819e-603b36b1cb75 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:16.331251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6277c-eff9-46b3-819e-603b36b1cb75 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:16.331524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6277c-eff9-46b3-819e-603b36b1cb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:16.352567 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-1dd6277c-eff9-46b3-819e-603b36b1cb75 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:16.361341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1dd6277c-eff9-46b3-819e-603b36b1cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:16.428158 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1352/2704] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:16.434175 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:16.435808 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:16.497490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0333c50-7f96-4ff7-9226-eec17a508a6f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:16.501131 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95b3a-a5b7-4902-b1f9-16f0465736f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:16.502048 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95b3a-a5b7-4902-b1f9-16f0465736f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:16.502177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95b3a-a5b7-4902-b1f9-16f0465736f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:16.507037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95b3a-a5b7-4902-b1f9-16f0465736f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:16.511703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95b3a-a5b7-4902-b1f9-16f0465736f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:16.513160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95b3a-a5b7-4902-b1f9-16f0465736f8 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:16.523420 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1353/2705] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:16.616508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6277c-eff9-46b3-819e-603b36b1cb75 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:16.616508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1dd6277c-eff9-46b3-819e-603b36b1cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:16.626362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6277c-eff9-46b3-819e-603b36b1cb75 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:16.649403 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:16.650787 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:16.651267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:16.651714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] PATH_INFO: `/v3/projects/287e34ba5dad4bffb314c948ffdaf405` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:16.653338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=287e34ba5dad4bffb314c948ffdaf405)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:16.668486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:16.793514 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287e34ba5dad4bffb314c948ffdaf405', 'request_id': 'req-839841ad-e386-4e70-89e9-0f9883b00d97'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.800440 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287e34ba5dad4bffb314c948ffdaf405', 'request_id': 'req-839841ad-e386-4e70-89e9-0f9883b00d97'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.807043 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287e34ba5dad4bffb314c948ffdaf405', 'request_id': 'req-839841ad-e386-4e70-89e9-0f9883b00d97'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.946801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] The token cache is being invalidate because project 287e34ba5dad4bffb314c948ffdaf405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:16.947044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.947642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:16.949181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1353/2706] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:16 2022] DELETE /identity/v3/projects/287e34ba5dad4bffb314c948ffdaf405 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:16.953162 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95b3a-a5b7-4902-b1f9-16f0465736f8 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:16.963242 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95b3a-a5b7-4902-b1f9-16f0465736f8 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:16.998018 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:17.019555 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:17.021780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:17.024935 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:17.025578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:17.025862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:17.026139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] PATH_INFO: `/v3/users/f11de22a9a9d40f49faf45a3a1e23b2b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:17.027303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11de22a9a9d40f49faf45a3a1e23b2b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:17.029598 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:17.043530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839841ad-e386-4e70-89e9-0f9883b00d97 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:17.049301 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:17.050021 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:17.050310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:17.050586 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] PATH_INFO: `/v3/projects/f2a465d324a2416dae6b1f4815a08577` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:17.051883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a465d324a2416dae6b1f4815a08577)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:17.053843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:17.062146 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:17.194930 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11de22a9a9d40f49faf45a3a1e23b2b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.195573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11de22a9a9d40f49faf45a3a1e23b2b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.199832 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a465d324a2416dae6b1f4815a08577', 'request_id': 'req-bedc405e-c141-4fc7-aab3-da3219af812e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.207444 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a465d324a2416dae6b1f4815a08577', 'request_id': 'req-bedc405e-c141-4fc7-aab3-da3219af812e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.213276 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a465d324a2416dae6b1f4815a08577', 'request_id': 'req-bedc405e-c141-4fc7-aab3-da3219af812e'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.289726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11de22a9a9d40f49faf45a3a1e23b2b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.297144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11de22a9a9d40f49faf45a3a1e23b2b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.314617 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11de22a9a9d40f49faf45a3a1e23b2b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.320797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1354/2707] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:16 2022] DELETE /identity/v3/users/f11de22a9a9d40f49faf45a3a1e23b2b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:17.392244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] The token cache is being invalidate because project f2a465d324a2416dae6b1f4815a08577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:17.392244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.392244 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.394491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1354/2708] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:17 2022] DELETE /identity/v3/projects/f2a465d324a2416dae6b1f4815a08577 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:17.395170 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:17.397098 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:17.473086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3f26c-6579-478a-b81b-f0877f6439a0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:17.478331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:17.478969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:17.479249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:17.479524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] PATH_INFO: `/v3/users/559b1d63f1ac4c5496fe6b358c638fb0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:17.480697 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559b1d63f1ac4c5496fe6b358c638fb0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:17.482671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:17.709661 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559b1d63f1ac4c5496fe6b358c638fb0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.710348 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559b1d63f1ac4c5496fe6b358c638fb0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.790951 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:17.792634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:17.821642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559b1d63f1ac4c5496fe6b358c638fb0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.833847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559b1d63f1ac4c5496fe6b358c638fb0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.854198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc549c65-2915-4bf1-9d8e-9c836f65db11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559b1d63f1ac4c5496fe6b358c638fb0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:17.862558 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1355/2709] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:17 2022] DELETE /identity/v3/users/559b1d63f1ac4c5496fe6b358c638fb0 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:17.907149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc405e-c141-4fc7-aab3-da3219af812e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:17.994324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:17.997272 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:17.999168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.000347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] PATH_INFO: `/v3/projects/5ec26f34d37a4353889130fa0051ae18` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.005858 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec26f34d37a4353889130fa0051ae18)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:18.021299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:18.187457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec26f34d37a4353889130fa0051ae18', 'request_id': 'req-6fd32613-8edb-4144-be80-d9e555bc7ad0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.195114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec26f34d37a4353889130fa0051ae18', 'request_id': 'req-6fd32613-8edb-4144-be80-d9e555bc7ad0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.203094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec26f34d37a4353889130fa0051ae18', 'request_id': 'req-6fd32613-8edb-4144-be80-d9e555bc7ad0'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.295693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] The token cache is being invalidate because project 5ec26f34d37a4353889130fa0051ae18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:18.295693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.295693 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6fd32613-8edb-4144-be80-d9e555bc7ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.300396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1355/2710] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:17 2022] DELETE /identity/v3/projects/5ec26f34d37a4353889130fa0051ae18 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:18.301916 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffbdb6-2ca0-4bcd-ab24-281788069524 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.302376 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffbdb6-2ca0-4bcd-ab24-281788069524 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.302495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffbdb6-2ca0-4bcd-ab24-281788069524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.346570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b6ffbdb6-2ca0-4bcd-ab24-281788069524 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:18.347918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b6ffbdb6-2ca0-4bcd-ab24-281788069524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:18.415334 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1356/2711] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:18.423634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8928ffa-abb1-48ea-8727-a0aaec8a3d08 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.423924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8928ffa-abb1-48ea-8727-a0aaec8a3d08 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.424379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8928ffa-abb1-48ea-8727-a0aaec8a3d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.456877 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffbdb6-2ca0-4bcd-ab24-281788069524 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:18.460336 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b6ffbdb6-2ca0-4bcd-ab24-281788069524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:18.478044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d8928ffa-abb1-48ea-8727-a0aaec8a3d08 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:18.479348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d8928ffa-abb1-48ea-8727-a0aaec8a3d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:18.495261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1356/2712] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:18.495374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffbdb6-2ca0-4bcd-ab24-281788069524 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:18.498205 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8928ffa-abb1-48ea-8727-a0aaec8a3d08 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:18.508955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:18.509495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8928ffa-abb1-48ea-8727-a0aaec8a3d08 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:18.509683 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.509967 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.510245 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] PATH_INFO: `/v3/projects/ea465b3ccf4b4512a745655725030bf4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.511523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea465b3ccf4b4512a745655725030bf4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:18.513676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:18.518309 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:18.523388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.523388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.523388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.523388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:18.523388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:18.523388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:18.542344 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1357/2713] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:18.552070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:18.558411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d4962-a8d7-49e9-8894-04d4d7d46d42 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:18.566544 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3648ba4-3b88-47a2-9bbf-e537c7bdaf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:18.567235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3648ba4-3b88-47a2-9bbf-e537c7bdaf6d admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.567615 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3648ba4-3b88-47a2-9bbf-e537c7bdaf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.567859 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3648ba4-3b88-47a2-9bbf-e537c7bdaf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.569133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3648ba4-3b88-47a2-9bbf-e537c7bdaf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:18.571831 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3648ba4-3b88-47a2-9bbf-e537c7bdaf6d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:18.680712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea465b3ccf4b4512a745655725030bf4', 'request_id': 'req-d6861d25-8f9e-4782-a051-ab982edd38cc'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.686139 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea465b3ccf4b4512a745655725030bf4', 'request_id': 'req-d6861d25-8f9e-4782-a051-ab982edd38cc'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.692986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea465b3ccf4b4512a745655725030bf4', 'request_id': 'req-d6861d25-8f9e-4782-a051-ab982edd38cc'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.744846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1358/2714] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:18 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:18.747904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3648ba4-3b88-47a2-9bbf-e537c7bdaf6d admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:18.769828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] The token cache is being invalidate because project ea465b3ccf4b4512a745655725030bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:18.769828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.773731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d6861d25-8f9e-4782-a051-ab982edd38cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:18.773731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1357/2715] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:18 2022] DELETE /identity/v3/projects/ea465b3ccf4b4512a745655725030bf4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:18.778391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459599b-44e4-49c6-be0d-5381c371f4e8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.778928 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459599b-44e4-49c6-be0d-5381c371f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.779428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459599b-44e4-49c6-be0d-5381c371f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.802765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5459599b-44e4-49c6-be0d-5381c371f4e8 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:18.803990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5459599b-44e4-49c6-be0d-5381c371f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:18.821672 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3648ba4-3b88-47a2-9bbf-e537c7bdaf6d admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:18.826692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f151b-2641-40a8-b587-a7853539edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:18.827418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f151b-2641-40a8-b587-a7853539edb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.827677 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f151b-2641-40a8-b587-a7853539edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.827947 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f151b-2641-40a8-b587-a7853539edb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.828604 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f151b-2641-40a8-b587-a7853539edb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:18.830856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f151b-2641-40a8-b587-a7853539edb7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:18.862433 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:18.869525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1358/2716] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:18.870141 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459599b-44e4-49c6-be0d-5381c371f4e8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:18.871460 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5459599b-44e4-49c6-be0d-5381c371f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:18.883343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459599b-44e4-49c6-be0d-5381c371f4e8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:18.887993 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:18.888623 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.888901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.889169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] PATH_INFO: `/v3/users/c2ae6ace5172469b907c069f482860f2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.890282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ae6ace5172469b907c069f482860f2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:18.892193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:18.935341 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1359/2717] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:18 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:18.940162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e0a8-9146-44d8-b9dc-72d286ed9492 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.940162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e0a8-9146-44d8-b9dc-72d286ed9492 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.940162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e0a8-9146-44d8-b9dc-72d286ed9492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.957111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c7c4e0a8-9146-44d8-b9dc-72d286ed9492 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:18.958414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c7c4e0a8-9146-44d8-b9dc-72d286ed9492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:18.966663 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1360/2718] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:18.967426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e0a8-9146-44d8-b9dc-72d286ed9492 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:18.968648 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c7c4e0a8-9146-44d8-b9dc-72d286ed9492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:18.981192 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:18.983646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e0a8-9146-44d8-b9dc-72d286ed9492 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:18.989277 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781e0f-a1fd-45b2-96f4-a0a79fd63418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:18.989877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781e0f-a1fd-45b2-96f4-a0a79fd63418 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:18.990159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781e0f-a1fd-45b2-96f4-a0a79fd63418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:18.990450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781e0f-a1fd-45b2-96f4-a0a79fd63418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:18.991703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40781e0f-a1fd-45b2-96f4-a0a79fd63418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:18.992940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40781e0f-a1fd-45b2-96f4-a0a79fd63418 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.003241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1361/2719] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:19.004098 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781e0f-a1fd-45b2-96f4-a0a79fd63418 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.013814 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781e0f-a1fd-45b2-96f4-a0a79fd63418 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.018537 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.019149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.019429 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.019703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.020404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:19.020719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.022687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.035765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1362/2720] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:19.036618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.046242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924279-ea41-4d0c-bc48-eed3edffa020 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.051652 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482ac47-9875-490e-84d3-c734f415d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.052223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482ac47-9875-490e-84d3-c734f415d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.052528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482ac47-9875-490e-84d3-c734f415d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.052848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482ac47-9875-490e-84d3-c734f415d1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.053427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482ac47-9875-490e-84d3-c734f415d1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.054976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482ac47-9875-490e-84d3-c734f415d1f4 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.065237 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1363/2721] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:19.066250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482ac47-9875-490e-84d3-c734f415d1f4 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.077413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482ac47-9875-490e-84d3-c734f415d1f4 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.082404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.082971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.083253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.083526 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.084133 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.086033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.104998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ae6ace5172469b907c069f482860f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:19.105653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ae6ace5172469b907c069f482860f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:19.170996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1364/2722] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:19 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:19.171841 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.176348 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:19.176506 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ae6ace5172469b907c069f482860f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:19.183268 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ae6ace5172469b907c069f482860f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:19.195331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ae6ace5172469b907c069f482860f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:19.201315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1359/2723] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:18 2022] DELETE /identity/v3/users/c2ae6ace5172469b907c069f482860f2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:19.202075 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.203457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:19.243324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a493855-cc2d-4aac-b8da-ab28795e2ccf admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.270481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafb10e-62b9-43f9-81fa-4d74abadb4cc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.276049 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d9e96-47ee-43f8-93e1-835c20d58364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.276686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d9e96-47ee-43f8-93e1-835c20d58364 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.276999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d9e96-47ee-43f8-93e1-835c20d58364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.283054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d9e96-47ee-43f8-93e1-835c20d58364 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.283054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d9e96-47ee-43f8-93e1-835c20d58364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.283054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d9e96-47ee-43f8-93e1-835c20d58364 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.305988 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.306581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.306864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.307142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] PATH_INFO: `/v3/projects/6dcf207d16524e4aa57164473ecb44d0/users/a205db3861c74f37902d744b04ccf29c/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.321704 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dcf207d16524e4aa57164473ecb44d0, user_id=a205db3861c74f37902d744b04ccf29c, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.324463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.403494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1360/2724] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:19 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:19.404768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7f3a-1014-49c9-aaed-2a0590d45de9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.405070 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7f3a-1014-49c9-aaed-2a0590d45de9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.405344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7f3a-1014-49c9-aaed-2a0590d45de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.424383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c90c7f3a-1014-49c9-aaed-2a0590d45de9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:19.425580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c90c7f3a-1014-49c9-aaed-2a0590d45de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:19.433237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1361/2725] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:19.434002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7f3a-1014-49c9-aaed-2a0590d45de9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.443671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7f3a-1014-49c9-aaed-2a0590d45de9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.448256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb54e88-44ba-43f2-bdf0-08e05e79a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.448919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb54e88-44ba-43f2-bdf0-08e05e79a39a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.450316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb54e88-44ba-43f2-bdf0-08e05e79a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.450316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb54e88-44ba-43f2-bdf0-08e05e79a39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.450316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb54e88-44ba-43f2-bdf0-08e05e79a39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.451684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb54e88-44ba-43f2-bdf0-08e05e79a39a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.464356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1365/2726] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:19 2022] PUT /identity/v3/projects/6dcf207d16524e4aa57164473ecb44d0/users/a205db3861c74f37902d744b04ccf29c/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:19.464356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.464356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:19.464761 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1362/2727] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:19.467515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb54e88-44ba-43f2-bdf0-08e05e79a39a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.486801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb54e88-44ba-43f2-bdf0-08e05e79a39a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.560751 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b00b4-fd4b-4970-b02d-21ed4616c09e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.564495 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d668-17bc-43d0-86b4-2c06a2e8995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.565016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6e8bc-792d-4389-8003-3134369f12f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.565145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d668-17bc-43d0-86b4-2c06a2e8995e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.565380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d668-17bc-43d0-86b4-2c06a2e8995e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.565622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6e8bc-792d-4389-8003-3134369f12f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.565747 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d668-17bc-43d0-86b4-2c06a2e8995e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.565928 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6e8bc-792d-4389-8003-3134369f12f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.566183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6e8bc-792d-4389-8003-3134369f12f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.566612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d668-17bc-43d0-86b4-2c06a2e8995e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.568285 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d668-17bc-43d0-86b4-2c06a2e8995e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.577644 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6e8bc-792d-4389-8003-3134369f12f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.578340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1363/2728] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:19.586932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6e8bc-792d-4389-8003-3134369f12f9 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.587094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d9df3-f96d-4086-9b48-29997900fca5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.587094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d9df3-f96d-4086-9b48-29997900fca5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.587094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d9df3-f96d-4086-9b48-29997900fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.593275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1366/2729] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:19.593579 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6e8bc-792d-4389-8003-3134369f12f9 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.604821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6e8bc-792d-4389-8003-3134369f12f9 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.609516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a08d9df3-f96d-4086-9b48-29997900fca5 None None] MFA Rules not processed for user `a205db3861c74f37902d744b04ccf29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:19.609835 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bdaf6-d7e5-408f-a2ba-e54d43a497c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.610721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bdaf6-d7e5-408f-a2ba-e54d43a497c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.610866 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a08d9df3-f96d-4086-9b48-29997900fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:19.613250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bdaf6-d7e5-408f-a2ba-e54d43a497c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.613250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bdaf6-d7e5-408f-a2ba-e54d43a497c9 admin admin] PATH_INFO: `/v3/projects/09bd1eacbda4473aa750a2e29b0b0592/users/c604a01fc4834c058cf388c5264b164b/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.628729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bdaf6-d7e5-408f-a2ba-e54d43a497c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bd1eacbda4473aa750a2e29b0b0592, user_id=c604a01fc4834c058cf388c5264b164b, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.633796 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bdaf6-d7e5-408f-a2ba-e54d43a497c9 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.700907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1364/2730] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:19.709081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d9df3-f96d-4086-9b48-29997900fca5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.721774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d9df3-f96d-4086-9b48-29997900fca5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.733459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab8aa6-cfdc-4931-bca4-50dc655330ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.734237 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8aa6-cfdc-4931-bca4-50dc655330ea admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.734523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8aa6-cfdc-4931-bca4-50dc655330ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.734800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8aa6-cfdc-4931-bca4-50dc655330ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.735438 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab8aa6-cfdc-4931-bca4-50dc655330ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.738756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab8aa6-cfdc-4931-bca4-50dc655330ea admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.746656 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1367/2731] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:19 2022] PUT /identity/v3/projects/09bd1eacbda4473aa750a2e29b0b0592/users/c604a01fc4834c058cf388c5264b164b/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:19.815660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5d21-d128-4e67-9be0-f6b94f5e3cdc None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.815660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5d21-d128-4e67-9be0-f6b94f5e3cdc None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.815660 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5d21-d128-4e67-9be0-f6b94f5e3cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.848359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-463e5d21-d128-4e67-9be0-f6b94f5e3cdc None None] MFA Rules not processed for user `c604a01fc4834c058cf388c5264b164b`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:19.849248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-463e5d21-d128-4e67-9be0-f6b94f5e3cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:19.858465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1365/2732] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:19 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:19.863021 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab8aa6-cfdc-4931-bca4-50dc655330ea admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.947402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1368/2733] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:19.950846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab8aa6-cfdc-4931-bca4-50dc655330ea admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:19.958397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad179c-76d3-4ba1-b8d0-e34516a3aa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:19.959225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad179c-76d3-4ba1-b8d0-e34516a3aa8f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:19.959513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad179c-76d3-4ba1-b8d0-e34516a3aa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:19.959786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad179c-76d3-4ba1-b8d0-e34516a3aa8f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:19.960457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad179c-76d3-4ba1-b8d0-e34516a3aa8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:19.961523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e5d21-d128-4e67-9be0-f6b94f5e3cdc None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:19.962764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad179c-76d3-4ba1-b8d0-e34516a3aa8f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:19.963111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-463e5d21-d128-4e67-9be0-f6b94f5e3cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:19.998446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:20.024533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e5d21-d128-4e67-9be0-f6b94f5e3cdc None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.061494 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1366/2734] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:19 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:20.066037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad179c-76d3-4ba1-b8d0-e34516a3aa8f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.076765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad179c-76d3-4ba1-b8d0-e34516a3aa8f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.081385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cbae2-5a14-4e45-9ae7-031c8480c959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.081681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e66f5-56bd-4c8c-b422-908aa7c29350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.082044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cbae2-5a14-4e45-9ae7-031c8480c959 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.082292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e66f5-56bd-4c8c-b422-908aa7c29350 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.082415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cbae2-5a14-4e45-9ae7-031c8480c959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.082666 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e66f5-56bd-4c8c-b422-908aa7c29350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.082793 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cbae2-5a14-4e45-9ae7-031c8480c959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.082880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e66f5-56bd-4c8c-b422-908aa7c29350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.083513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e66f5-56bd-4c8c-b422-908aa7c29350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.085284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e66f5-56bd-4c8c-b422-908aa7c29350 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.101611 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:20.101889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1367/2735] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:20.102674 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e66f5-56bd-4c8c-b422-908aa7c29350 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.118835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e66f5-56bd-4c8c-b422-908aa7c29350 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.123884 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bac774-c88f-4cc0-b440-9e5d55c14a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.124587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac774-c88f-4cc0-b440-9e5d55c14a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.124868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac774-c88f-4cc0-b440-9e5d55c14a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.125143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bac774-c88f-4cc0-b440-9e5d55c14a64 admin admin] PATH_INFO: `/v3/projects/0f01351046584e199bea30abc9197d66/users/f68bdbe3af1043a5834c2888b4c0e568/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.141885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bac774-c88f-4cc0-b440-9e5d55c14a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f01351046584e199bea30abc9197d66, user_id=f68bdbe3af1043a5834c2888b4c0e568, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.144599 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bac774-c88f-4cc0-b440-9e5d55c14a64 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.152139 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cbae2-5a14-4e45-9ae7-031c8480c959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.153692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cbae2-5a14-4e45-9ae7-031c8480c959 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.162846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1369/2736] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:20.183482 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cbae2-5a14-4e45-9ae7-031c8480c959 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.195168 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cbae2-5a14-4e45-9ae7-031c8480c959 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.200242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.200790 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.201064 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.205287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] PATH_INFO: `/v3/users/c604a01fc4834c058cf388c5264b164b` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.205287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c604a01fc4834c058cf388c5264b164b)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.205287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.228345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1368/2737] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:20 2022] PUT /identity/v3/projects/0f01351046584e199bea30abc9197d66/users/f68bdbe3af1043a5834c2888b4c0e568/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:20.231983 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bac774-c88f-4cc0-b440-9e5d55c14a64 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.293120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bac774-c88f-4cc0-b440-9e5d55c14a64 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.297781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.298913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.299191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.299459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.300107 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.301720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.321118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1369/2738] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:20.321118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.321118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:20.333868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d9112-a730-4b37-9b6f-2af7901c85aa admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.344567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.344567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.344567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.344567 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] PATH_INFO: `/v3/projects/0ab5c4bf14474562ab9bf63367169c9b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.345016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab5c4bf14474562ab9bf63367169c9b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.345016 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.423291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c604a01fc4834c058cf388c5264b164b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.505224 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab5c4bf14474562ab9bf63367169c9b', 'request_id': 'req-49a95415-28a9-43e1-a04a-324870e57168'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.510505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab5c4bf14474562ab9bf63367169c9b', 'request_id': 'req-49a95415-28a9-43e1-a04a-324870e57168'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.518095 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab5c4bf14474562ab9bf63367169c9b', 'request_id': 'req-49a95415-28a9-43e1-a04a-324870e57168'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.580627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c604a01fc4834c058cf388c5264b164b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.581353 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c604a01fc4834c058cf388c5264b164b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.597967 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c604a01fc4834c058cf388c5264b164b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.598742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c604a01fc4834c058cf388c5264b164b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.618714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1370/2739] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:20 2022] DELETE /identity/v3/users/c604a01fc4834c058cf388c5264b164b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:20.621729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.621729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:20.667485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] The token cache is being invalidate because project 0ab5c4bf14474562ab9bf63367169c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:20.672743 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.674548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-49a95415-28a9-43e1-a04a-324870e57168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:20.677715 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1370/2740] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:20 2022] DELETE /identity/v3/projects/0ab5c4bf14474562ab9bf63367169c9b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:20.678712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc4c8a-e5ac-40cd-8386-250debda7262 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.678986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc4c8a-e5ac-40cd-8386-250debda7262 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.679255 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc4c8a-e5ac-40cd-8386-250debda7262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.709999 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffa094-5368-49f9-81c7-1499e9a6bdb7 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.712500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-64cc4c8a-e5ac-40cd-8386-250debda7262 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:20.714325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-64cc4c8a-e5ac-40cd-8386-250debda7262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:20.719017 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.720439 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.720906 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.721274 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] PATH_INFO: `/v3/projects/0f01351046584e199bea30abc9197d66/users/f68bdbe3af1043a5834c2888b4c0e568/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.723355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f01351046584e199bea30abc9197d66, user_id=f68bdbe3af1043a5834c2888b4c0e568, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.726117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.727522 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1371/2741] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:20.731499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc4c8a-e5ac-40cd-8386-250debda7262 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.733973 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-64cc4c8a-e5ac-40cd-8386-250debda7262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:20.749560 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc4c8a-e5ac-40cd-8386-250debda7262 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.753603 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1371/2742] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:20 2022] PUT /identity/v3/projects/0f01351046584e199bea30abc9197d66/users/f68bdbe3af1043a5834c2888b4c0e568/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:20.759435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.764486 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:20.781475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:20.831858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.832485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.832765 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.833038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] PATH_INFO: `/v3/users/9ec0e27b56b64b9695b61aa444ff8a82` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.835552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec0e27b56b64b9695b61aa444ff8a82)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.838062 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.846516 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff18a-7b4f-42d4-a6f9-c149f5769fbc admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:20.851766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099df468-a3b6-4e74-8612-d5f5db32f593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:20.852442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099df468-a3b6-4e74-8612-d5f5db32f593 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.852721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099df468-a3b6-4e74-8612-d5f5db32f593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.852993 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099df468-a3b6-4e74-8612-d5f5db32f593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.863034 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099df468-a3b6-4e74-8612-d5f5db32f593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:20.864512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099df468-a3b6-4e74-8612-d5f5db32f593 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:20.874116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1372/2743] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:20.875379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36767d5-ffd2-4d3a-a0ea-eb8a6a83023a None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:20.875669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36767d5-ffd2-4d3a-a0ea-eb8a6a83023a None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:20.875962 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36767d5-ffd2-4d3a-a0ea-eb8a6a83023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:20.905629 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c36767d5-ffd2-4d3a-a0ea-eb8a6a83023a None None] MFA Rules not processed for user `f68bdbe3af1043a5834c2888b4c0e568`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:20.906874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c36767d5-ffd2-4d3a-a0ea-eb8a6a83023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:20.981423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:20.984132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1373/2744] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:20.996524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36767d5-ffd2-4d3a-a0ea-eb8a6a83023a None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:20.997990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c36767d5-ffd2-4d3a-a0ea-eb8a6a83023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:21.054250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36767d5-ffd2-4d3a-a0ea-eb8a6a83023a None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:21.057880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fef50f-d75e-453b-9636-fc0cc53fa2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:21.058482 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fef50f-d75e-453b-9636-fc0cc53fa2ab service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:21.058763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fef50f-d75e-453b-9636-fc0cc53fa2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:21.059039 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fef50f-d75e-453b-9636-fc0cc53fa2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:21.069932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fef50f-d75e-453b-9636-fc0cc53fa2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:21.071399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fef50f-d75e-453b-9636-fc0cc53fa2ab service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:21.080924 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1374/2745] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:21.114270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec0e27b56b64b9695b61aa444ff8a82'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.114941 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec0e27b56b64b9695b61aa444ff8a82'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.197758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec0e27b56b64b9695b61aa444ff8a82'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.207299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec0e27b56b64b9695b61aa444ff8a82'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.220768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec0e27b56b64b9695b61aa444ff8a82'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.227174 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1372/2746] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:20 2022] DELETE /identity/v3/users/9ec0e27b56b64b9695b61aa444ff8a82 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:21.315588 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fef50f-d75e-453b-9636-fc0cc53fa2ab service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:21.324296 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fef50f-d75e-453b-9636-fc0cc53fa2ab service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:21.366243 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:21.367792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:21.374396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e113ee9-0f93-4d2f-ac1a-5392fdc255b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:21.375529 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e113ee9-0f93-4d2f-ac1a-5392fdc255b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:21.378238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:21.382676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e113ee9-0f93-4d2f-ac1a-5392fdc255b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:21.382676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e113ee9-0f93-4d2f-ac1a-5392fdc255b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:21.383622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-1e113ee9-0f93-4d2f-ac1a-5392fdc255b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:21.438417 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:21.456295 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72133eba-050c-4f8a-9cbc-5cb2b0dd362d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:21.461219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:21.461848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:21.462124 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:21.462442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] PATH_INFO: `/v3/projects/09bd1eacbda4473aa750a2e29b0b0592` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:21.463950 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bd1eacbda4473aa750a2e29b0b0592)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:21.465463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e113ee9-0f93-4d2f-ac1a-5392fdc255b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:21.466002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:21.466473 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e113ee9-0f93-4d2f-ac1a-5392fdc255b2 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:21.475715 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1375/2747] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:21.610382 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bd1eacbda4473aa750a2e29b0b0592', 'request_id': 'req-2a025d04-520c-4fea-a47b-d9d42c9b3acb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.618063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bd1eacbda4473aa750a2e29b0b0592', 'request_id': 'req-2a025d04-520c-4fea-a47b-d9d42c9b3acb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.626722 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bd1eacbda4473aa750a2e29b0b0592', 'request_id': 'req-2a025d04-520c-4fea-a47b-d9d42c9b3acb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.750179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] The token cache is being invalidate because project 09bd1eacbda4473aa750a2e29b0b0592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:21.750468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.751728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:21.753481 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1373/2748] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:21 2022] DELETE /identity/v3/projects/09bd1eacbda4473aa750a2e29b0b0592 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:21.758659 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056e6f-b258-4b5b-989b-65e11bc40ba1 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:21.759084 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056e6f-b258-4b5b-989b-65e11bc40ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:21.759371 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056e6f-b258-4b5b-989b-65e11bc40ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:21.778950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d6056e6f-b258-4b5b-989b-65e11bc40ba1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:21.782592 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:21.783518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d6056e6f-b258-4b5b-989b-65e11bc40ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:21.792374 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:21.800547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:21.856147 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1376/2749] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:21.864432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf416-b5a6-4f11-8e68-cc3bb1a88d7e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:21.864432 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf416-b5a6-4f11-8e68-cc3bb1a88d7e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:21.864863 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdf416-b5a6-4f11-8e68-cc3bb1a88d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:21.882136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025d04-520c-4fea-a47b-d9d42c9b3acb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:21.886430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-8fcdf416-b5a6-4f11-8e68-cc3bb1a88d7e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:21.886810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:21.887450 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:21.887728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:21.888002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] PATH_INFO: `/v3/projects/cea07d6a4e4849d9b44d104c8f876f8c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:21.888114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8fcdf416-b5a6-4f11-8e68-cc3bb1a88d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:21.889216 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea07d6a4e4849d9b44d104c8f876f8c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:21.891061 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:21.897378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1377/2750] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:21.901273 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdf416-b5a6-4f11-8e68-cc3bb1a88d7e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:21.911451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdf416-b5a6-4f11-8e68-cc3bb1a88d7e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:21.916241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:21.916854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:21.917134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:21.917408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:21.918059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80613) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:21.918689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:21.919995 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:21.932875 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1378/2751] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:30:21.937282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:21.947282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf1d66-cd06-4092-bdaf-03a0d748b0fb admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:21.952242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950d0c-5a6d-44a1-bc9b-9785f6547b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:21.952880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950d0c-5a6d-44a1-bc9b-9785f6547b7e admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:21.953161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950d0c-5a6d-44a1-bc9b-9785f6547b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:21.953434 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950d0c-5a6d-44a1-bc9b-9785f6547b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:21.954058 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79950d0c-5a6d-44a1-bc9b-9785f6547b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:21.955975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79950d0c-5a6d-44a1-bc9b-9785f6547b7e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.045051 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea07d6a4e4849d9b44d104c8f876f8c', 'request_id': 'req-be4a095e-d9bf-40d7-b4cc-2f64171d4676'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:22.052023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea07d6a4e4849d9b44d104c8f876f8c', 'request_id': 'req-be4a095e-d9bf-40d7-b4cc-2f64171d4676'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:22.058471 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea07d6a4e4849d9b44d104c8f876f8c', 'request_id': 'req-be4a095e-d9bf-40d7-b4cc-2f64171d4676'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:22.088737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1379/2752] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:21 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:22.089974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950d0c-5a6d-44a1-bc9b-9785f6547b7e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.135202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:22.151501 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950d0c-5a6d-44a1-bc9b-9785f6547b7e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.156175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.156809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.157088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.157378 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.157985 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.160398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.180422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] The token cache is being invalidate because project cea07d6a4e4849d9b44d104c8f876f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:22.180422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:22.180676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be4a095e-d9bf-40d7-b4cc-2f64171d4676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:22.182642 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1374/2753] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:21 2022] DELETE /identity/v3/projects/cea07d6a4e4849d9b44d104c8f876f8c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:22.187234 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3653a4-3c70-46c7-90fc-3a0ad9be9765 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.187523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3653a4-3c70-46c7-90fc-3a0ad9be9765 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.187792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3653a4-3c70-46c7-90fc-3a0ad9be9765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.209233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1f3653a4-3c70-46c7-90fc-3a0ad9be9765 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:22.210659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f3653a4-3c70-46c7-90fc-3a0ad9be9765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:22.219733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1375/2754] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:22.228114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0b9c-a2f4-4f52-b470-51c5528d003e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.228431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0b9c-a2f4-4f52-b470-51c5528d003e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.228709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0b9c-a2f4-4f52-b470-51c5528d003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.236108 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1380/2755] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:22 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:22.238646 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.243610 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:22.250218 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bafe0b9c-a2f4-4f52-b470-51c5528d003e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:22.251710 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bafe0b9c-a2f4-4f52-b470-51c5528d003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:22.253282 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030c90a-6d24-4b98-b214-e07ad600a273 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.258177 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbae47d-7a4a-40e4-81e0-3b06a5927341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.258812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae47d-7a4a-40e4-81e0-3b06a5927341 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.259094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae47d-7a4a-40e4-81e0-3b06a5927341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.259397 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae47d-7a4a-40e4-81e0-3b06a5927341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.260200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbae47d-7a4a-40e4-81e0-3b06a5927341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.260663 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1376/2756] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:22.264250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbae47d-7a4a-40e4-81e0-3b06a5927341 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.265009 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe0b9c-a2f4-4f52-b470-51c5528d003e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.274171 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1381/2757] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:22.276505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe0b9c-a2f4-4f52-b470-51c5528d003e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.282470 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbae47d-7a4a-40e4-81e0-3b06a5927341 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.283590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.285024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.285346 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.285709 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.286403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:22.286701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.288428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.301088 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1377/2758] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:30:22.308667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.310496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbae47d-7a4a-40e4-81e0-3b06a5927341 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.315460 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d882f0-d321-46b0-ae7f-22ee1b128d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.316069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d882f0-d321-46b0-ae7f-22ee1b128d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.316477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d882f0-d321-46b0-ae7f-22ee1b128d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.316744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d882f0-d321-46b0-ae7f-22ee1b128d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.317441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d882f0-d321-46b0-ae7f-22ee1b128d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.319832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7cbaa-4c6a-47de-947e-37b1ebb5ff03 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.319952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d882f0-d321-46b0-ae7f-22ee1b128d5a admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.325288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42dc54-cf5c-41a8-83c7-e04f8ca15531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.325986 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42dc54-cf5c-41a8-83c7-e04f8ca15531 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.326173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42dc54-cf5c-41a8-83c7-e04f8ca15531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.326434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42dc54-cf5c-41a8-83c7-e04f8ca15531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.327064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42dc54-cf5c-41a8-83c7-e04f8ca15531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.328997 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42dc54-cf5c-41a8-83c7-e04f8ca15531 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.333419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1382/2759] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:22.337550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d882f0-d321-46b0-ae7f-22ee1b128d5a admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.348426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d882f0-d321-46b0-ae7f-22ee1b128d5a admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.353326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5dff-3058-42e5-b977-ee73bfdaf653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.353978 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5dff-3058-42e5-b977-ee73bfdaf653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.354254 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5dff-3058-42e5-b977-ee73bfdaf653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.354527 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5dff-3058-42e5-b977-ee73bfdaf653 admin admin] PATH_INFO: `/v3/projects/2346dcca05324f70a9bea6924feb8916/users/df6630519a4147f89f76b9daacded711/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.370321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5dff-3058-42e5-b977-ee73bfdaf653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2346dcca05324f70a9bea6924feb8916, user_id=df6630519a4147f89f76b9daacded711, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.372976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5dff-3058-42e5-b977-ee73bfdaf653 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.419673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1378/2760] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:22 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:22.419673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610f6c9-c9eb-4c00-8649-4b05177526a6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.419673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610f6c9-c9eb-4c00-8649-4b05177526a6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.419673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610f6c9-c9eb-4c00-8649-4b05177526a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.437689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4610f6c9-c9eb-4c00-8649-4b05177526a6 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:22.438893 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4610f6c9-c9eb-4c00-8649-4b05177526a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:22.473190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1383/2761] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:22 2022] PUT /identity/v3/projects/2346dcca05324f70a9bea6924feb8916/users/df6630519a4147f89f76b9daacded711/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:22.477436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5dff-3058-42e5-b977-ee73bfdaf653 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.496759 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1379/2762] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:30:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:22.497995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487435da-6494-48b7-a1bc-054a91ca7189 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.498280 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487435da-6494-48b7-a1bc-054a91ca7189 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.498556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487435da-6494-48b7-a1bc-054a91ca7189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.528774 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-487435da-6494-48b7-a1bc-054a91ca7189 None None] MFA Rules not processed for user `df6630519a4147f89f76b9daacded711`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:22.530105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-487435da-6494-48b7-a1bc-054a91ca7189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:22.549784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5dff-3058-42e5-b977-ee73bfdaf653 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.554613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.555302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.555596 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.555864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.556784 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.558723 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.596750 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1380/2763] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:22.607608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487435da-6494-48b7-a1bc-054a91ca7189 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.608970 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-487435da-6494-48b7-a1bc-054a91ca7189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:22.632721 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1384/2764] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:22 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:22.633904 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.635765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:22.666351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487435da-6494-48b7-a1bc-054a91ca7189 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.669978 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b541bc-a20c-4883-98fb-bfef05befe7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.670583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b541bc-a20c-4883-98fb-bfef05befe7f service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.670864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b541bc-a20c-4883-98fb-bfef05befe7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.671138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b541bc-a20c-4883-98fb-bfef05befe7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.680032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b541bc-a20c-4883-98fb-bfef05befe7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.681830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b541bc-a20c-4883-98fb-bfef05befe7f service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.692023 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1381/2765] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:22.692919 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b541bc-a20c-4883-98fb-bfef05befe7f service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.703053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b541bc-a20c-4883-98fb-bfef05befe7f service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.708026 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a42ce-73d1-4863-b253-394aa9e8f98c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.710309 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ade3-cfca-4a39-9357-f94ca027da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.710969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ade3-cfca-4a39-9357-f94ca027da34 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.711456 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ade3-cfca-4a39-9357-f94ca027da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.712087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ade3-cfca-4a39-9357-f94ca027da34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.713345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ade3-cfca-4a39-9357-f94ca027da34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.716032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54245755-140c-48b0-90d0-d66369386a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.716032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245755-140c-48b0-90d0-d66369386a72 service swift] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.716032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245755-140c-48b0-90d0-d66369386a72 service swift] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.716032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245755-140c-48b0-90d0-d66369386a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.716375 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ade3-cfca-4a39-9357-f94ca027da34 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.726343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1382/2766] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:22.729966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ade3-cfca-4a39-9357-f94ca027da34 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.741081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ade3-cfca-4a39-9357-f94ca027da34 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.747801 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b821b5-ec86-4981-a31a-23a74cd22e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.748595 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b821b5-ec86-4981-a31a-23a74cd22e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.748875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b821b5-ec86-4981-a31a-23a74cd22e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.749146 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b821b5-ec86-4981-a31a-23a74cd22e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.749805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b821b5-ec86-4981-a31a-23a74cd22e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.751440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b821b5-ec86-4981-a31a-23a74cd22e2f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.763269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1383/2767] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:22.767407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b821b5-ec86-4981-a31a-23a74cd22e2f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:22.779134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b821b5-ec86-4981-a31a-23a74cd22e2f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:22.783584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54245755-140c-48b0-90d0-d66369386a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.784383 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fb9a2-9cf9-44a5-b8db-c3bd370dba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:22.785285 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54245755-140c-48b0-90d0-d66369386a72 service swift] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.785454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fb9a2-9cf9-44a5-b8db-c3bd370dba1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.785716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fb9a2-9cf9-44a5-b8db-c3bd370dba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.786065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fb9a2-9cf9-44a5-b8db-c3bd370dba1c admin admin] PATH_INFO: `/v3/projects/2b316af53bc745d9979b5c50a443a540/users/abc8a677b1b64a43a469ee51e5f0e8f5/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.792915 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:22.797459 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1385/2768] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:30:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:30:22.802755 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fb9a2-9cf9-44a5-b8db-c3bd370dba1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b316af53bc745d9979b5c50a443a540, user_id=abc8a677b1b64a43a469ee51e5f0e8f5, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:22.806360 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fb9a2-9cf9-44a5-b8db-c3bd370dba1c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:22.825398 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:22.906672 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1384/2769] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:22 2022] PUT /identity/v3/projects/2b316af53bc745d9979b5c50a443a540/users/abc8a677b1b64a43a469ee51e5f0e8f5/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:22.917235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f74f3-3cd4-4930-a426-dcf2d82cb1f6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:22.917464 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f74f3-3cd4-4930-a426-dcf2d82cb1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:22.917737 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f74f3-3cd4-4930-a426-dcf2d82cb1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:22.949474 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:22.952472 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-087f74f3-3cd4-4930-a426-dcf2d82cb1f6 None None] MFA Rules not processed for user `abc8a677b1b64a43a469ee51e5f0e8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:22.954137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-087f74f3-3cd4-4930-a426-dcf2d82cb1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:23.021674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1386/2770] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:23.026781 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fb9a2-9cf9-44a5-b8db-c3bd370dba1c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:23.101427 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fb9a2-9cf9-44a5-b8db-c3bd370dba1c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:23.105556 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa5a8-58c0-4b04-8de9-89e4dd15ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:23.108106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa5a8-58c0-4b04-8de9-89e4dd15ddcc admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.108106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa5a8-58c0-4b04-8de9-89e4dd15ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.108106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa5a8-58c0-4b04-8de9-89e4dd15ddcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.108106 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aa5a8-58c0-4b04-8de9-89e4dd15ddcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:23.109528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aa5a8-58c0-4b04-8de9-89e4dd15ddcc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:23.231219 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:23.238727 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1385/2771] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:23 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:23.242682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f74f3-3cd4-4930-a426-dcf2d82cb1f6 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:23.253763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f74f3-3cd4-4930-a426-dcf2d82cb1f6 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:23.282948 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:23.314496 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8126761-ff74-413e-8f9e-d0b1ab9524fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:23.315665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8126761-ff74-413e-8f9e-d0b1ab9524fe admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.315937 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8126761-ff74-413e-8f9e-d0b1ab9524fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.316210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8126761-ff74-413e-8f9e-d0b1ab9524fe admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.316889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8126761-ff74-413e-8f9e-d0b1ab9524fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:23.318844 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8126761-ff74-413e-8f9e-d0b1ab9524fe admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:23.390582 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1387/2772] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:23 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:23.394824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa5a8-58c0-4b04-8de9-89e4dd15ddcc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:23.406013 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa5a8-58c0-4b04-8de9-89e4dd15ddcc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:23.412476 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b4848-b087-452b-b817-cf44a03198b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:23.412800 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b4848-b087-452b-b817-cf44a03198b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.413202 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b4848-b087-452b-b817-cf44a03198b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.413393 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b4848-b087-452b-b817-cf44a03198b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.414004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b4848-b087-452b-b817-cf44a03198b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:23.415590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b4848-b087-452b-b817-cf44a03198b3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:23.432891 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1386/2773] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:23.434327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8126761-ff74-413e-8f9e-d0b1ab9524fe admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:23.451971 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8126761-ff74-413e-8f9e-d0b1ab9524fe admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:23.453014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38282c-c394-41ab-927e-32e2f24cf98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:23.453760 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38282c-c394-41ab-927e-32e2f24cf98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.454044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38282c-c394-41ab-927e-32e2f24cf98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.454328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38282c-c394-41ab-927e-32e2f24cf98e admin admin] PATH_INFO: `/v3/projects/5439e130619744c1bf98d2f15f9fa43d/users/6d9f8479e78e41cca3b33e5670940a51/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.473848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38282c-c394-41ab-927e-32e2f24cf98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5439e130619744c1bf98d2f15f9fa43d, user_id=6d9f8479e78e41cca3b33e5670940a51, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:23.476911 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38282c-c394-41ab-927e-32e2f24cf98e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:23.558719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1388/2774] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:23 2022] PUT /identity/v3/projects/5439e130619744c1bf98d2f15f9fa43d/users/6d9f8479e78e41cca3b33e5670940a51/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:23.563635 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b4848-b087-452b-b817-cf44a03198b3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:23.574056 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b4848-b087-452b-b817-cf44a03198b3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:23.629371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a51fd6-5b32-4610-8c74-dbea9bc1e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:23.629979 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51fd6-5b32-4610-8c74-dbea9bc1e33a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.630318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51fd6-5b32-4610-8c74-dbea9bc1e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.630604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51fd6-5b32-4610-8c74-dbea9bc1e33a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.631244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a51fd6-5b32-4610-8c74-dbea9bc1e33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:23.632839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a51fd6-5b32-4610-8c74-dbea9bc1e33a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:23.642444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1387/2775] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:23.649364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38282c-c394-41ab-927e-32e2f24cf98e admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:23.660009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38282c-c394-41ab-927e-32e2f24cf98e admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:23.664714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a346-5a77-472e-9423-5100da075013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:23.665370 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a346-5a77-472e-9423-5100da075013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.665642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a346-5a77-472e-9423-5100da075013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.665913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a346-5a77-472e-9423-5100da075013 admin admin] PATH_INFO: `/v3/projects/5439e130619744c1bf98d2f15f9fa43d/users/6d9f8479e78e41cca3b33e5670940a51/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.667887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1a346-5a77-472e-9423-5100da075013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5439e130619744c1bf98d2f15f9fa43d, user_id=6d9f8479e78e41cca3b33e5670940a51, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:23.670687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1a346-5a77-472e-9423-5100da075013 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:23.682183 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1389/2776] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:23 2022] PUT /identity/v3/projects/5439e130619744c1bf98d2f15f9fa43d/users/6d9f8479e78e41cca3b33e5670940a51/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:23.694332 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270af75-6157-4858-9a79-2084089e882a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.695864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270af75-6157-4858-9a79-2084089e882a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.695864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270af75-6157-4858-9a79-2084089e882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.724972 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e270af75-6157-4858-9a79-2084089e882a None None] MFA Rules not processed for user `6d9f8479e78e41cca3b33e5670940a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:23.728798 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e270af75-6157-4858-9a79-2084089e882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:23.730213 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974ef1a-44a4-4425-ad92-423e75b7d97e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.730500 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974ef1a-44a4-4425-ad92-423e75b7d97e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.730776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974ef1a-44a4-4425-ad92-423e75b7d97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.750854 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-b974ef1a-44a4-4425-ad92-423e75b7d97e None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:23.753520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b974ef1a-44a4-4425-ad92-423e75b7d97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:23.793667 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:23.800857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1388/2777] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:23.811592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270af75-6157-4858-9a79-2084089e882a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:23.813019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e270af75-6157-4858-9a79-2084089e882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:23.816054 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1390/2778] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 11:30:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:23.832019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974ef1a-44a4-4425-ad92-423e75b7d97e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:23.871918 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270af75-6157-4858-9a79-2084089e882a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:23.875530 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5192-6ae9-4a09-bcd1-09cf9ede7877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:23.876134 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5192-6ae9-4a09-bcd1-09cf9ede7877 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.876452 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5192-6ae9-4a09-bcd1-09cf9ede7877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.876711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5192-6ae9-4a09-bcd1-09cf9ede7877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.888880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f5192-6ae9-4a09-bcd1-09cf9ede7877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:23.890463 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f5192-6ae9-4a09-bcd1-09cf9ede7877 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:23.902578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1389/2779] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:23.904014 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974ef1a-44a4-4425-ad92-423e75b7d97e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:23.909431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9bf25-ecd5-4819-a613-43cb22bc9d62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:23.910041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9bf25-ecd5-4819-a613-43cb22bc9d62 service swift] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:23.910517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9bf25-ecd5-4819-a613-43cb22bc9d62 service swift] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:23.910622 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9bf25-ecd5-4819-a613-43cb22bc9d62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:23.919649 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9bf25-ecd5-4819-a613-43cb22bc9d62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:23.921363 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9bf25-ecd5-4819-a613-43cb22bc9d62 service swift] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:23.931315 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1391/2780] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:30:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 11:30:24.106490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:24.475875 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5192-6ae9-4a09-bcd1-09cf9ede7877 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:24.546868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5192-6ae9-4a09-bcd1-09cf9ede7877 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:24.552464 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:24.553102 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:24.553380 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:24.553650 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] PATH_INFO: `/v3/users/abc8a677b1b64a43a469ee51e5f0e8f5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:24.554793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc8a677b1b64a43a469ee51e5f0e8f5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:24.556758 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:24.603760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:24.626938 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3284-dc78-4116-b59c-215fd209da43 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:24.628030 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3284-dc78-4116-b59c-215fd209da43 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:24.628148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3284-dc78-4116-b59c-215fd209da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:24.647173 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-695e3284-dc78-4116-b59c-215fd209da43 None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:24.648445 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-695e3284-dc78-4116-b59c-215fd209da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:24.655725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1392/2781] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 10 11:30:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:24.667597 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e3284-dc78-4116-b59c-215fd209da43 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:24.681304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e3284-dc78-4116-b59c-215fd209da43 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:24.686836 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471d76a-8a6d-461a-b480-5734facee2d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:24.687447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471d76a-8a6d-461a-b480-5734facee2d9 service swift] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:24.687730 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471d76a-8a6d-461a-b480-5734facee2d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:24.688212 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471d76a-8a6d-461a-b480-5734facee2d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:24.697380 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471d76a-8a6d-461a-b480-5734facee2d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:24.699116 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471d76a-8a6d-461a-b480-5734facee2d9 service swift] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:24.707203 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1393/2782] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:30:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 11:30:24.741706 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc8a677b1b64a43a469ee51e5f0e8f5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:24.742721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc8a677b1b64a43a469ee51e5f0e8f5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:24.844150 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc8a677b1b64a43a469ee51e5f0e8f5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:24.851862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc8a677b1b64a43a469ee51e5f0e8f5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:24.863824 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc8a677b1b64a43a469ee51e5f0e8f5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:24.869604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1390/2783] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:24 2022] DELETE /identity/v3/users/abc8a677b1b64a43a469ee51e5f0e8f5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:24.880072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84cbf5-7983-4078-912e-fd52b049b480 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:24.880072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84cbf5-7983-4078-912e-fd52b049b480 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:24.880072 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84cbf5-7983-4078-912e-fd52b049b480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:24.894198 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-7b84cbf5-7983-4078-912e-fd52b049b480 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:24.895385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7b84cbf5-7983-4078-912e-fd52b049b480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:24.953442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1394/2784] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:24.964519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:24.968999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:25.028261 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166856d-82d4-4218-a193-98d8ec4f1223 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:25.031909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:25.032551 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:25.032838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:25.033108 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:25.042838 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:25.044197 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:25.054491 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1391/2785] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:25.354161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22970d6-9785-487e-bd5b-bf9e4de45ecf None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:25.354671 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22970d6-9785-487e-bd5b-bf9e4de45ecf None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:25.355471 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22970d6-9785-487e-bd5b-bf9e4de45ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:25.378889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-a22970d6-9785-487e-bd5b-bf9e4de45ecf None None] MFA Rules not processed for user `b609ab814003472c9579134a5c91ab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:25.380149 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a22970d6-9785-487e-bd5b-bf9e4de45ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:25.431547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:25.438833 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1395/2786] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 10 11:30:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:25.452290 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:25.453860 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:25.473731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:25.528207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e7bd-ee68-46db-98ac-91b149c2a02d service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:25.533325 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e6981-e7e1-4806-ad7e-755ae1fc267b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f582800a7004e78a6fab0038b94cb8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:25.534091 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e6981-e7e1-4806-ad7e-755ae1fc267b service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:25.534354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e6981-e7e1-4806-ad7e-755ae1fc267b service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:25.534629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e6981-e7e1-4806-ad7e-755ae1fc267b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:25.542957 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e6981-e7e1-4806-ad7e-755ae1fc267b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:25.544647 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e6981-e7e1-4806-ad7e-755ae1fc267b service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:25.553462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1392/2787] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 10 11:30:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 11:30:25.566092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22970d6-9785-487e-bd5b-bf9e4de45ecf None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:25.567664 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-a22970d6-9785-487e-bd5b-bf9e4de45ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:25.586384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22970d6-9785-487e-bd5b-bf9e4de45ecf None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:25.592799 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:25.595703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:25.595703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:25.595703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] PATH_INFO: `/v3/projects/2b316af53bc745d9979b5c50a443a540` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:25.595703 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b316af53bc745d9979b5c50a443a540)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:25.597230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:25.730261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b316af53bc745d9979b5c50a443a540', 'request_id': 'req-04141782-de14-4ba8-be0d-451c41ea106b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:25.736643 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b316af53bc745d9979b5c50a443a540', 'request_id': 'req-04141782-de14-4ba8-be0d-451c41ea106b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:25.742413 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b316af53bc745d9979b5c50a443a540', 'request_id': 'req-04141782-de14-4ba8-be0d-451c41ea106b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:25.873154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] The token cache is being invalidate because project 2b316af53bc745d9979b5c50a443a540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:25.873443 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:25.874105 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:25.875892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1396/2788] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:25 2022] DELETE /identity/v3/projects/2b316af53bc745d9979b5c50a443a540 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:25.880594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e6981-e7e1-4806-ad7e-755ae1fc267b service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:25.891169 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e6981-e7e1-4806-ad7e-755ae1fc267b service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:25.948186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:25.948837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:25.949113 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:25.949385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] PATH_INFO: `/v3/users/6d9f8479e78e41cca3b33e5670940a51` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:25.950540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9f8479e78e41cca3b33e5670940a51)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:25.952490 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:26.179636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9f8479e78e41cca3b33e5670940a51'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:26.180323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9f8479e78e41cca3b33e5670940a51'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:26.285024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9f8479e78e41cca3b33e5670940a51'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:26.292569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9f8479e78e41cca3b33e5670940a51'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:26.304073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-baecf8b2-53ea-4f8c-b749-3d01a22534f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9f8479e78e41cca3b33e5670940a51'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:26.309966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1393/2789] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:25 2022] DELETE /identity/v3/users/6d9f8479e78e41cca3b33e5670940a51 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:26.834714 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:26.837326 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:26.853304 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04141782-de14-4ba8-be0d-451c41ea106b admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:26.925447 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:26.926091 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:26.926430 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:26.926712 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] PATH_INFO: `/v3/projects/5439e130619744c1bf98d2f15f9fa43d` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:26.931913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5439e130619744c1bf98d2f15f9fa43d)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:26.931913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:27.053136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5439e130619744c1bf98d2f15f9fa43d', 'request_id': 'req-a8e5444b-093e-4637-b6b8-103b6569ca1b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:27.059545 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5439e130619744c1bf98d2f15f9fa43d', 'request_id': 'req-a8e5444b-093e-4637-b6b8-103b6569ca1b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:27.066386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5439e130619744c1bf98d2f15f9fa43d', 'request_id': 'req-a8e5444b-093e-4637-b6b8-103b6569ca1b'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:27.157502 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] The token cache is being invalidate because project 5439e130619744c1bf98d2f15f9fa43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:27.159193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:27.159193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-a8e5444b-093e-4637-b6b8-103b6569ca1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:27.160920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1397/2790] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:26 2022] DELETE /identity/v3/projects/5439e130619744c1bf98d2f15f9fa43d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:27.166628 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196b86-5c92-4988-ad77-de3cbcc4694b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.167083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196b86-5c92-4988-ad77-de3cbcc4694b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.167195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f196b86-5c92-4988-ad77-de3cbcc4694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.188428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0f196b86-5c92-4988-ad77-de3cbcc4694b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:27.189733 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0f196b86-5c92-4988-ad77-de3cbcc4694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:27.208723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:27.249612 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1394/2791] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:27.257661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76354827-bea4-4ff3-8846-c8c0f588fa6e None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.258020 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76354827-bea4-4ff3-8846-c8c0f588fa6e None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.258193 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76354827-bea4-4ff3-8846-c8c0f588fa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.281680 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-76354827-bea4-4ff3-8846-c8c0f588fa6e None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:27.283073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-76354827-bea4-4ff3-8846-c8c0f588fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:27.293322 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1398/2792] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:27.298151 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f196b86-5c92-4988-ad77-de3cbcc4694b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:27.309340 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f196b86-5c92-4988-ad77-de3cbcc4694b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:27.313975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:27.314580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.315024 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.315303 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.315954 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:27.316248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:27.317976 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:27.330354 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1395/2793] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:30:27.336666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76354827-bea4-4ff3-8846-c8c0f588fa6e None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:27.347812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76354827-bea4-4ff3-8846-c8c0f588fa6e None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:27.352620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972aeda-8416-45c2-8176-3eb158dee450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:27.353223 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972aeda-8416-45c2-8176-3eb158dee450 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.353506 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972aeda-8416-45c2-8176-3eb158dee450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.353821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972aeda-8416-45c2-8176-3eb158dee450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.354448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972aeda-8416-45c2-8176-3eb158dee450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:27.356453 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972aeda-8416-45c2-8176-3eb158dee450 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:27.361065 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:27.482303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1399/2794] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:27 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:27.484292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:27.494802 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f42be1-d05f-4da6-a61f-bba9de053cde admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:27.556414 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955fb00-4963-4fc1-9053-9fdcbe6a5234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:27.557017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955fb00-4963-4fc1-9053-9fdcbe6a5234 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.557339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955fb00-4963-4fc1-9053-9fdcbe6a5234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.557679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955fb00-4963-4fc1-9053-9fdcbe6a5234 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.558188 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955fb00-4963-4fc1-9053-9fdcbe6a5234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:27.560081 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955fb00-4963-4fc1-9053-9fdcbe6a5234 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:27.652038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1396/2795] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:27 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:27.652680 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972aeda-8416-45c2-8176-3eb158dee450 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:27.664862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972aeda-8416-45c2-8176-3eb158dee450 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:27.670495 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b02a5-0664-41a8-9b30-155dfe1c3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:27.671316 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b02a5-0664-41a8-9b30-155dfe1c3aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.671780 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b02a5-0664-41a8-9b30-155dfe1c3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.671944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b02a5-0664-41a8-9b30-155dfe1c3aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.672920 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b02a5-0664-41a8-9b30-155dfe1c3aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:27.676797 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b02a5-0664-41a8-9b30-155dfe1c3aa5 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:27.706899 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1400/2796] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:27.709430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955fb00-4963-4fc1-9053-9fdcbe6a5234 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:27.719837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955fb00-4963-4fc1-9053-9fdcbe6a5234 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:27.727084 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff640510-d782-4bee-89da-0451b7fc78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:27.727847 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640510-d782-4bee-89da-0451b7fc78b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.729269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640510-d782-4bee-89da-0451b7fc78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.729269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff640510-d782-4bee-89da-0451b7fc78b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.729269 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff640510-d782-4bee-89da-0451b7fc78b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:27.732344 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff640510-d782-4bee-89da-0451b7fc78b9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:27.745735 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1397/2797] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:27.753421 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b02a5-0664-41a8-9b30-155dfe1c3aa5 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:27.761570 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b02a5-0664-41a8-9b30-155dfe1c3aa5 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:27.766412 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:27.767165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.767477 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.767851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] PATH_INFO: `/v3/projects/425a1493a620429282fe9996b86eb689/users/95351f030c4a4acd8d72581591c90fd9/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.785569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425a1493a620429282fe9996b86eb689, user_id=95351f030c4a4acd8d72581591c90fd9, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:27.788211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:27.878454 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1401/2798] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:27 2022] PUT /identity/v3/projects/425a1493a620429282fe9996b86eb689/users/95351f030c4a4acd8d72581591c90fd9/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:27.889756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938949-691f-449b-86cb-5f665c925e53 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:27.890040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938949-691f-449b-86cb-5f665c925e53 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:27.890317 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3938949-691f-449b-86cb-5f665c925e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:27.919629 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e3938949-691f-449b-86cb-5f665c925e53 None None] MFA Rules not processed for user `95351f030c4a4acd8d72581591c90fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:27.920254 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e3938949-691f-449b-86cb-5f665c925e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:27.995832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1398/2799] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:28.018409 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:28.020111 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:28.082379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a0ad7-1f44-4596-b60d-d1e71398fe83 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:28.086117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3eee-f858-4082-bb62-9b3097f91235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:28.086727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3eee-f858-4082-bb62-9b3097f91235 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:28.087013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3eee-f858-4082-bb62-9b3097f91235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:28.087306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3eee-f858-4082-bb62-9b3097f91235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:28.097914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b3eee-f858-4082-bb62-9b3097f91235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:28.099411 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b3eee-f858-4082-bb62-9b3097f91235 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:28.108898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1402/2800] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:28.669857 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3938949-691f-449b-86cb-5f665c925e53 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:28.671335 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e3938949-691f-449b-86cb-5f665c925e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:28.693929 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:28.756345 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3938949-691f-449b-86cb-5f665c925e53 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:28.761887 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:28.769442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:28.769442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:28.769442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] PATH_INFO: `/v3/users/a205db3861c74f37902d744b04ccf29c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:28.769442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a205db3861c74f37902d744b04ccf29c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:28.769442 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:29.025138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a205db3861c74f37902d744b04ccf29c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.025786 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a205db3861c74f37902d744b04ccf29c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.066070 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a205db3861c74f37902d744b04ccf29c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.073793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a205db3861c74f37902d744b04ccf29c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.086581 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a205db3861c74f37902d744b04ccf29c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.092579 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1399/2801] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:28 2022] DELETE /identity/v3/users/a205db3861c74f37902d744b04ccf29c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:29.097697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1923-7ff3-4f24-ba95-6b3a55cec3d5 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:29.098179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1923-7ff3-4f24-ba95-6b3a55cec3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:29.098331 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1923-7ff3-4f24-ba95-6b3a55cec3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:29.119068 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-abed1923-7ff3-4f24-ba95-6b3a55cec3d5 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:29.120559 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-abed1923-7ff3-4f24-ba95-6b3a55cec3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:29.140792 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:29.142305 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:29.185032 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1403/2802] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:29.195422 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed1923-7ff3-4f24-ba95-6b3a55cec3d5 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:29.202912 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-abed1923-7ff3-4f24-ba95-6b3a55cec3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:29.209610 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723c4a8-1c2e-4865-9310-71be189e2b1d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:29.214274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:29.214902 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:29.215186 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:29.215500 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] PATH_INFO: `/v3/users/deac7740a1364c50b3d5b110e227978b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:29.216732 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deac7740a1364c50b3d5b110e227978b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:29.219449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:29.264057 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed1923-7ff3-4f24-ba95-6b3a55cec3d5 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:29.267779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f95e2-6689-4347-b2fe-b5ab8e4d75ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:29.268342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f95e2-6689-4347-b2fe-b5ab8e4d75ac service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:29.268634 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f95e2-6689-4347-b2fe-b5ab8e4d75ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:29.269451 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f95e2-6689-4347-b2fe-b5ab8e4d75ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:29.277676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:29.279944 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f95e2-6689-4347-b2fe-b5ab8e4d75ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:29.281390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f95e2-6689-4347-b2fe-b5ab8e4d75ac service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:29.291493 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1404/2803] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:29.433977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:29.439343 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deac7740a1364c50b3d5b110e227978b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.440207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deac7740a1364c50b3d5b110e227978b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.493896 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deac7740a1364c50b3d5b110e227978b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.501525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deac7740a1364c50b3d5b110e227978b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.514745 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deac7740a1364c50b3d5b110e227978b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:29.522605 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1400/2804] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:29 2022] DELETE /identity/v3/users/deac7740a1364c50b3d5b110e227978b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:29.528048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478891d-7ae8-460b-af9f-324c906fb04f None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:29.528048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478891d-7ae8-460b-af9f-324c906fb04f None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:29.528048 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478891d-7ae8-460b-af9f-324c906fb04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:29.549462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-7478891d-7ae8-460b-af9f-324c906fb04f None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:29.551144 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7478891d-7ae8-460b-af9f-324c906fb04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:29.615398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1405/2805] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:29.625351 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:29.626751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:29.686466 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2660dd0-5036-4811-88b8-5783818a4726 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:29.690241 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:29.691435 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:29.691694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:29.691966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:29.701191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:29.702591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:29.712545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1401/2806] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:29.735491 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478891d-7ae8-460b-af9f-324c906fb04f None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:29.737110 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-7478891d-7ae8-460b-af9f-324c906fb04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:29.750190 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478891d-7ae8-460b-af9f-324c906fb04f None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:29.761515 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:29.762235 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:29.766134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:29.766134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] PATH_INFO: `/v3/projects/6dcf207d16524e4aa57164473ecb44d0` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:29.766134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dcf207d16524e4aa57164473ecb44d0)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:29.766134 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:29.963604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:29.965033 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:29.978284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcc475-21ce-4c93-b86c-0b4dec6b1031 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:29.982897 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:29.983552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:29.983842 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:29.984779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] PATH_INFO: `/v3/projects/107d777cdd074bc2ae78b59d3fc19392` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:29.985322 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107d777cdd074bc2ae78b59d3fc19392)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:29.987219 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:30.072107 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dcf207d16524e4aa57164473ecb44d0', 'request_id': 'req-400c0b27-47d0-4e9a-b636-55025fe67e98'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.078210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dcf207d16524e4aa57164473ecb44d0', 'request_id': 'req-400c0b27-47d0-4e9a-b636-55025fe67e98'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.084319 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dcf207d16524e4aa57164473ecb44d0', 'request_id': 'req-400c0b27-47d0-4e9a-b636-55025fe67e98'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.122653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107d777cdd074bc2ae78b59d3fc19392', 'request_id': 'req-84091ff0-ae54-441d-82f9-74c6cde60ea8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.128389 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107d777cdd074bc2ae78b59d3fc19392', 'request_id': 'req-84091ff0-ae54-441d-82f9-74c6cde60ea8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.138277 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107d777cdd074bc2ae78b59d3fc19392', 'request_id': 'req-84091ff0-ae54-441d-82f9-74c6cde60ea8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.181095 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] The token cache is being invalidate because project 6dcf207d16524e4aa57164473ecb44d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:30.181613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.182406 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.183996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1406/2807] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:29 2022] DELETE /identity/v3/projects/6dcf207d16524e4aa57164473ecb44d0 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:30.188702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:30.190227 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:30.255917 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0b27-47d0-4e9a-b636-55025fe67e98 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:30.267160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] The token cache is being invalidate because project 107d777cdd074bc2ae78b59d3fc19392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:30.267499 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.268315 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.270720 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1402/2808] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:29 2022] DELETE /identity/v3/projects/107d777cdd074bc2ae78b59d3fc19392 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:30.286563 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:30.322308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:30.324198 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:30.330070 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:30.330874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:30.331163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:30.331517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] PATH_INFO: `/v3/users/f68bdbe3af1043a5834c2888b4c0e568` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:30.333575 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68bdbe3af1043a5834c2888b4c0e568)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:30.335810 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:30.341282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84091ff0-ae54-441d-82f9-74c6cde60ea8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:30.350407 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:30.351462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:30.351748 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:30.352644 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] PATH_INFO: `/v3/users/df6630519a4147f89f76b9daacded711` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:30.354074 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6630519a4147f89f76b9daacded711)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:30.356523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:30.587120 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68bdbe3af1043a5834c2888b4c0e568'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.610858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:30.617590 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6630519a4147f89f76b9daacded711'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.618273 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6630519a4147f89f76b9daacded711'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.689316 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68bdbe3af1043a5834c2888b4c0e568'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.689930 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68bdbe3af1043a5834c2888b4c0e568'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.703040 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68bdbe3af1043a5834c2888b4c0e568'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.703682 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-ee5108e4-ee98-47b5-9665-cc281735caca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68bdbe3af1043a5834c2888b4c0e568'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.716229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1407/2809] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:30 2022] DELETE /identity/v3/users/f68bdbe3af1043a5834c2888b4c0e568 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:30.774639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6630519a4147f89f76b9daacded711'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.782913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6630519a4147f89f76b9daacded711'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.797207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6630519a4147f89f76b9daacded711'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:30.804524 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1403/2810] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:30 2022] DELETE /identity/v3/users/df6630519a4147f89f76b9daacded711 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:30.812616 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d34c-59f1-40b8-9dd1-88f5ea241864 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:30.812922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d34c-59f1-40b8-9dd1-88f5ea241864 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:30.813898 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d34c-59f1-40b8-9dd1-88f5ea241864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:30.833976 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c192d34c-59f1-40b8-9dd1-88f5ea241864 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:30.835631 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c192d34c-59f1-40b8-9dd1-88f5ea241864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:30.901283 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1408/2811] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:30.912689 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:30.914370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:30.979536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27113198-1153-4efa-b826-ab0c0bfc0b08 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:30.983145 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:30.983756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:30.984038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:30.984333 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:30.994110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:30.995507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.006434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1404/2812] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:31.121044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192d34c-59f1-40b8-9dd1-88f5ea241864 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:31.122560 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c192d34c-59f1-40b8-9dd1-88f5ea241864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.135124 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192d34c-59f1-40b8-9dd1-88f5ea241864 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:31.140584 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:31.141222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.141498 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.141771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] PATH_INFO: `/v3/projects/0f01351046584e199bea30abc9197d66` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.143090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f01351046584e199bea30abc9197d66)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:31.145651 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.222189 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:31.223577 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.236329 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa327-f188-4857-a788-e0a406c4e42e service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:31.241350 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:31.241964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.242239 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.242508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] PATH_INFO: `/v3/users/95351f030c4a4acd8d72581591c90fd9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.243602 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95351f030c4a4acd8d72581591c90fd9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:31.245572 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.266253 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:31.274366 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f01351046584e199bea30abc9197d66', 'request_id': 'req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.280531 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f01351046584e199bea30abc9197d66', 'request_id': 'req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.286060 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f01351046584e199bea30abc9197d66', 'request_id': 'req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.387210 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] The token cache is being invalidate because project 0f01351046584e199bea30abc9197d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:31.387554 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.399121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-6323f73d-911c-4737-bf3a-d41ca0f4ce5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.399121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1409/2813] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:31 2022] DELETE /identity/v3/projects/0f01351046584e199bea30abc9197d66 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:31.399121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179905f-25e5-486c-b84f-a03a480c0f84 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.399121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179905f-25e5-486c-b84f-a03a480c0f84 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.399121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179905f-25e5-486c-b84f-a03a480c0f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.414669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-e179905f-25e5-486c-b84f-a03a480c0f84 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:31.416877 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-e179905f-25e5-486c-b84f-a03a480c0f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.431136 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95351f030c4a4acd8d72581591c90fd9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.431865 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95351f030c4a4acd8d72581591c90fd9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.477066 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1410/2814] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:31.481841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95351f030c4a4acd8d72581591c90fd9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.486825 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefb62-30b9-4c6a-88fa-b574dc44e6a9 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.487305 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefb62-30b9-4c6a-88fa-b574dc44e6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.488349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eefb62-30b9-4c6a-88fa-b574dc44e6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.496771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95351f030c4a4acd8d72581591c90fd9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.505684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-aa5c9b9b-5dff-4d49-8544-64e092898f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95351f030c4a4acd8d72581591c90fd9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.508576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-22eefb62-30b9-4c6a-88fa-b574dc44e6a9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:31.509802 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-22eefb62-30b9-4c6a-88fa-b574dc44e6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.511868 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1405/2815] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:31 2022] DELETE /identity/v3/users/95351f030c4a4acd8d72581591c90fd9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:31.516160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b18d-af39-4783-9bdf-9c4f336d2f87 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.519864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b18d-af39-4783-9bdf-9c4f336d2f87 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.519864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b18d-af39-4783-9bdf-9c4f336d2f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.539764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-58c1b18d-af39-4783-9bdf-9c4f336d2f87 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:31.541017 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-58c1b18d-af39-4783-9bdf-9c4f336d2f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.569205 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:31.577959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1411/2816] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:31.581456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefb62-30b9-4c6a-88fa-b574dc44e6a9 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:31.581456 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-22eefb62-30b9-4c6a-88fa-b574dc44e6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.591997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eefb62-30b9-4c6a-88fa-b574dc44e6a9 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:31.599423 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:31.600055 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.600390 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.600668 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] PATH_INFO: `/v3/projects/2346dcca05324f70a9bea6924feb8916` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.601795 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2346dcca05324f70a9bea6924feb8916)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:31.603694 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.606962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1406/2817] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:31.607837 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1b18d-af39-4783-9bdf-9c4f336d2f87 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:31.618253 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1b18d-af39-4783-9bdf-9c4f336d2f87 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:31.623054 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:31.627547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.627547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.627547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.627547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:31.627547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:31.627547 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.639519 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1407/2818] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:31.640300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:31.642110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.699942 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd19b0-8060-45c9-aed6-8bdc61dd8df0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:31.709674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2346dcca05324f70a9bea6924feb8916', 'request_id': 'req-77cf03fd-a565-493d-866e-105f1e89e3f1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.716201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2346dcca05324f70a9bea6924feb8916', 'request_id': 'req-77cf03fd-a565-493d-866e-105f1e89e3f1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.722853 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2346dcca05324f70a9bea6924feb8916', 'request_id': 'req-77cf03fd-a565-493d-866e-105f1e89e3f1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.725871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:31.749969 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42bf0d-ea30-47d6-a9fa-5b3eb67c4677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:31.750592 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42bf0d-ea30-47d6-a9fa-5b3eb67c4677 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.750882 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42bf0d-ea30-47d6-a9fa-5b3eb67c4677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.751156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42bf0d-ea30-47d6-a9fa-5b3eb67c4677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.809475 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] The token cache is being invalidate because project 2346dcca05324f70a9bea6924feb8916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:31.809771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.810462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:31.812164 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1412/2819] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:31 2022] DELETE /identity/v3/projects/2346dcca05324f70a9bea6924feb8916 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:31.813190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42bf0d-ea30-47d6-a9fa-5b3eb67c4677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:31.813742 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:31.814618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.814934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42bf0d-ea30-47d6-a9fa-5b3eb67c4677 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.825338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1408/2820] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:31.826725 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805c406-6ec8-4c6a-a4e4-19e3ecf28593 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.827078 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805c406-6ec8-4c6a-a4e4-19e3ecf28593 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.827425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805c406-6ec8-4c6a-a4e4-19e3ecf28593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.828281 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf03fd-a565-493d-866e-105f1e89e3f1 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:31.834705 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90621f0-10f7-4be3-aabe-4d0710916795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:31.835408 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90621f0-10f7-4be3-aabe-4d0710916795 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.835765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90621f0-10f7-4be3-aabe-4d0710916795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.836163 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90621f0-10f7-4be3-aabe-4d0710916795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.837388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90621f0-10f7-4be3-aabe-4d0710916795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:31.838922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90621f0-10f7-4be3-aabe-4d0710916795 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.848528 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f805c406-6ec8-4c6a-a4e4-19e3ecf28593 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:31.849810 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f805c406-6ec8-4c6a-a4e4-19e3ecf28593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.859000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1409/2821] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:31.868515 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fa368-34f7-4bf2-83de-7eefed195c54 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.868883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fa368-34f7-4bf2-83de-7eefed195c54 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.869232 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fa368-34f7-4bf2-83de-7eefed195c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.888971 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c93fa368-34f7-4bf2-83de-7eefed195c54 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:31.890274 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c93fa368-34f7-4bf2-83de-7eefed195c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:31.898962 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1410/2822] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:31.903331 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fa368-34f7-4bf2-83de-7eefed195c54 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:31.913995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fa368-34f7-4bf2-83de-7eefed195c54 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:31.918975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:31.919591 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.919871 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.920144 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.920859 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:31.921327 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:31.922933 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.935214 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1411/2823] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 11:30:31.939573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:31.949104 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba08037-b28d-448d-815d-7441f627e7ba admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:31.953845 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c84ba-330d-45bc-a140-641b13fb9e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:31.954431 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c84ba-330d-45bc-a140-641b13fb9e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:31.955596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c84ba-330d-45bc-a140-641b13fb9e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:31.955596 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c84ba-330d-45bc-a140-641b13fb9e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:31.955836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c84ba-330d-45bc-a140-641b13fb9e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:31.958065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c84ba-330d-45bc-a140-641b13fb9e86 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:31.963275 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1413/2824] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:31 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:31.964115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90621f0-10f7-4be3-aabe-4d0710916795 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.026123 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90621f0-10f7-4be3-aabe-4d0710916795 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.030925 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11640304-6913-4e26-a2f3-55c73dec01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.031530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640304-6913-4e26-a2f3-55c73dec01f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.031813 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640304-6913-4e26-a2f3-55c73dec01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.032090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640304-6913-4e26-a2f3-55c73dec01f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.032743 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11640304-6913-4e26-a2f3-55c73dec01f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.035368 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11640304-6913-4e26-a2f3-55c73dec01f5 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.079664 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1412/2825] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:31 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:32.084998 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c84ba-330d-45bc-a140-641b13fb9e86 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.102374 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1414/2826] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:31 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:32.105894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11640304-6913-4e26-a2f3-55c73dec01f5 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.116036 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11640304-6913-4e26-a2f3-55c73dec01f5 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.166173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c84ba-330d-45bc-a140-641b13fb9e86 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.174083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58869125-0f83-4074-b268-77e28d51add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.174704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58869125-0f83-4074-b268-77e28d51add7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.174989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58869125-0f83-4074-b268-77e28d51add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.175526 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58869125-0f83-4074-b268-77e28d51add7 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.176159 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58869125-0f83-4074-b268-77e28d51add7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.178486 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58869125-0f83-4074-b268-77e28d51add7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.179657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bcfc2-1b17-48a1-9008-b09dbafcf9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.180334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bcfc2-1b17-48a1-9008-b09dbafcf9db admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.180708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bcfc2-1b17-48a1-9008-b09dbafcf9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.180983 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bcfc2-1b17-48a1-9008-b09dbafcf9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.182376 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bcfc2-1b17-48a1-9008-b09dbafcf9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.183673 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bcfc2-1b17-48a1-9008-b09dbafcf9db admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.194302 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1415/2827] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:32.198094 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bcfc2-1b17-48a1-9008-b09dbafcf9db admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.209349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bcfc2-1b17-48a1-9008-b09dbafcf9db admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.214096 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338a31-3a50-42f4-bbaf-fddf75736cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.214695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338a31-3a50-42f4-bbaf-fddf75736cff admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.214977 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338a31-3a50-42f4-bbaf-fddf75736cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.215252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338a31-3a50-42f4-bbaf-fddf75736cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.215889 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16338a31-3a50-42f4-bbaf-fddf75736cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.217566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16338a31-3a50-42f4-bbaf-fddf75736cff admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.227446 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1416/2828] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:32.231508 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338a31-3a50-42f4-bbaf-fddf75736cff admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.243544 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338a31-3a50-42f4-bbaf-fddf75736cff admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.248181 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520cbb-c644-437b-b545-11b62e9b4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.248862 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cbb-c644-437b-b545-11b62e9b4164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.249169 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cbb-c644-437b-b545-11b62e9b4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.249571 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cbb-c644-437b-b545-11b62e9b4164 admin admin] PATH_INFO: `/v3/projects/85b307a0fede4457a30c54a0edc4f34b/users/1e1e463f18e94c608b0b60186d821411/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.262825 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1413/2829] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:32 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:32.267528 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30520cbb-c644-437b-b545-11b62e9b4164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b307a0fede4457a30c54a0edc4f34b, user_id=1e1e463f18e94c608b0b60186d821411, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.267979 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30520cbb-c644-437b-b545-11b62e9b4164 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.268655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58869125-0f83-4074-b268-77e28d51add7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.278907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58869125-0f83-4074-b268-77e28d51add7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.283655 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073ae5-5f38-4716-b57e-68bf18967eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.286539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073ae5-5f38-4716-b57e-68bf18967eda admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.286539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073ae5-5f38-4716-b57e-68bf18967eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.286539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073ae5-5f38-4716-b57e-68bf18967eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.286539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073ae5-5f38-4716-b57e-68bf18967eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.287294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073ae5-5f38-4716-b57e-68bf18967eda admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.297094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1414/2830] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:32.301550 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073ae5-5f38-4716-b57e-68bf18967eda admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.311839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073ae5-5f38-4716-b57e-68bf18967eda admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.318225 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.319087 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.319371 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.319702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.320270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.322711 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.337194 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1415/2831] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:32.340620 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1417/2832] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:32 2022] PUT /identity/v3/projects/85b307a0fede4457a30c54a0edc4f34b/users/1e1e463f18e94c608b0b60186d821411/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:32.340740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.340740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:32.342576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520cbb-c644-437b-b545-11b62e9b4164 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.353339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeec8d-239e-44e5-8b5d-c10fa9826596 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.387826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:32.410941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520cbb-c644-437b-b545-11b62e9b4164 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.411622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.412250 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.412561 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.412831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] PATH_INFO: `/v3/projects/425a1493a620429282fe9996b86eb689` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.414003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425a1493a620429282fe9996b86eb689)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.415880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.416250 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fcfc-58ce-4fea-ac23-09046fbf72d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.416932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fcfc-58ce-4fea-ac23-09046fbf72d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.419137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fcfc-58ce-4fea-ac23-09046fbf72d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.419137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fcfc-58ce-4fea-ac23-09046fbf72d2 admin admin] PATH_INFO: `/v3/projects/e8de0ade51414ed2b9df9609c1d818e2/users/880b09b5fa3747a1a2836ea4a7c563ba/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.432623 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fcfc-58ce-4fea-ac23-09046fbf72d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8de0ade51414ed2b9df9609c1d818e2, user_id=880b09b5fa3747a1a2836ea4a7c563ba, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.435289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fcfc-58ce-4fea-ac23-09046fbf72d2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.466398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:32.495251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1418/2833] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:32 2022] PUT /identity/v3/projects/e8de0ade51414ed2b9df9609c1d818e2/users/880b09b5fa3747a1a2836ea4a7c563ba/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:32.496481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f752ce-c008-48a0-a52e-6e0e4ea59ae8 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.496764 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f752ce-c008-48a0-a52e-6e0e4ea59ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.497038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f752ce-c008-48a0-a52e-6e0e4ea59ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.523867 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:32.524801 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-37f752ce-c008-48a0-a52e-6e0e4ea59ae8 None None] MFA Rules not processed for user `1e1e463f18e94c608b0b60186d821411`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:32.526044 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-37f752ce-c008-48a0-a52e-6e0e4ea59ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:32.526848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425a1493a620429282fe9996b86eb689', 'request_id': 'req-58899738-dc82-49f6-93ec-4cd2a4892803'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:32.532292 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425a1493a620429282fe9996b86eb689', 'request_id': 'req-58899738-dc82-49f6-93ec-4cd2a4892803'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:32.539659 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425a1493a620429282fe9996b86eb689', 'request_id': 'req-58899738-dc82-49f6-93ec-4cd2a4892803'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:32.589861 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1419/2834] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:32.591097 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78196-1739-4eba-8936-0087b89c9279 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.591249 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] The token cache is being invalidate because project 425a1493a620429282fe9996b86eb689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:32.591362 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78196-1739-4eba-8936-0087b89c9279 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.591637 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78196-1739-4eba-8936-0087b89c9279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.591836 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:32.592634 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-58899738-dc82-49f6-93ec-4cd2a4892803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:32.594458 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1416/2835] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:32 2022] DELETE /identity/v3/projects/425a1493a620429282fe9996b86eb689 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:32.602768 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0675b8-adc9-42dc-abec-0a40593fc885 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.603068 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0675b8-adc9-42dc-abec-0a40593fc885 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.603339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0675b8-adc9-42dc-abec-0a40593fc885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.622217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-c6e78196-1739-4eba-8936-0087b89c9279 None None] MFA Rules not processed for user `880b09b5fa3747a1a2836ea4a7c563ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:32.623425 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c6e78196-1739-4eba-8936-0087b89c9279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:32.625520 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0e0675b8-adc9-42dc-abec-0a40593fc885 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:32.626815 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0e0675b8-adc9-42dc-abec-0a40593fc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:32.686699 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1417/2836] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:32.687548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1420/2837] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:32.687990 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0675b8-adc9-42dc-abec-0a40593fc885 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.689430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0e0675b8-adc9-42dc-abec-0a40593fc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:32.695365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e78196-1739-4eba-8936-0087b89c9279 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.696887 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c6e78196-1739-4eba-8936-0087b89c9279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:32.710642 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e78196-1739-4eba-8936-0087b89c9279 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.715903 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcff9d-2471-4e7e-a269-7f32f6f4de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.716543 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcff9d-2471-4e7e-a269-7f32f6f4de68 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.716880 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcff9d-2471-4e7e-a269-7f32f6f4de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.717278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcff9d-2471-4e7e-a269-7f32f6f4de68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.717943 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcff9d-2471-4e7e-a269-7f32f6f4de68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.719932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcff9d-2471-4e7e-a269-7f32f6f4de68 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.747041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0675b8-adc9-42dc-abec-0a40593fc885 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.751025 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741f890-ea13-4c7f-b827-827f3cd16806 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcc7327f524a450e8429b5008166e5d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.751636 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f890-ea13-4c7f-b827-827f3cd16806 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.751917 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f890-ea13-4c7f-b827-827f3cd16806 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.752193 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f890-ea13-4c7f-b827-827f3cd16806 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.754079 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5741f890-ea13-4c7f-b827-827f3cd16806 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:32.764766 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741f890-ea13-4c7f-b827-827f3cd16806 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.766173 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741f890-ea13-4c7f-b827-827f3cd16806 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.775726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1418/2838] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:32.776780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450d31e-a33f-4a7f-9b91-974c9f093ec9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.777529 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450d31e-a33f-4a7f-9b91-974c9f093ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.777529 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450d31e-a33f-4a7f-9b91-974c9f093ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.796505 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a450d31e-a33f-4a7f-9b91-974c9f093ec9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:32.797701 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a450d31e-a33f-4a7f-9b91-974c9f093ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:32.805964 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1419/2839] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:32.821365 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1421/2840] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:32 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:32.821582 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450d31e-a33f-4a7f-9b91-974c9f093ec9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.823442 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcff9d-2471-4e7e-a269-7f32f6f4de68 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.834975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450d31e-a33f-4a7f-9b91-974c9f093ec9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.896729 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:32.899827 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcff9d-2471-4e7e-a269-7f32f6f4de68 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.904300 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.905094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.905377 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106947ec-7ace-4eaa-81b9-59a77b59369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.905684 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.905989 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106947ec-7ace-4eaa-81b9-59a77b59369f admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.906118 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.906270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106947ec-7ace-4eaa-81b9-59a77b59369f admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.906548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106947ec-7ace-4eaa-81b9-59a77b59369f admin admin] PATH_INFO: `/v3/users` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.907037 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:30:32.907156 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106947ec-7ace-4eaa-81b9-59a77b59369f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.907508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.909122 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106947ec-7ace-4eaa-81b9-59a77b59369f admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.909279 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:32.922339 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1420/2841] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:30:32.926723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:32.938040 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515d1f-ace3-4093-a5c2-f1986c209a20 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:32.941716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:32.944065 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e30461-5499-4564-85d3-3c8735e8ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:32.944780 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e30461-5499-4564-85d3-3c8735e8ac80 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:32.945060 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e30461-5499-4564-85d3-3c8735e8ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:32.945342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e30461-5499-4564-85d3-3c8735e8ac80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:32.945989 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e30461-5499-4564-85d3-3c8735e8ac80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:32.947880 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e30461-5499-4564-85d3-3c8735e8ac80 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.017400 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1422/2842] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:32 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:30:33.018251 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106947ec-7ace-4eaa-81b9-59a77b59369f admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.029132 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106947ec-7ace-4eaa-81b9-59a77b59369f admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.034530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5620b48-0876-4d99-b641-0095b3c056de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.039268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5620b48-0876-4d99-b641-0095b3c056de admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.039268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5620b48-0876-4d99-b641-0095b3c056de admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.039268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5620b48-0876-4d99-b641-0095b3c056de admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.039268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5620b48-0876-4d99-b641-0095b3c056de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.039268 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5620b48-0876-4d99-b641-0095b3c056de admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.049534 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1423/2843] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:33.053674 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5620b48-0876-4d99-b641-0095b3c056de admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.063259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5620b48-0876-4d99-b641-0095b3c056de admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.067987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1421/2844] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:30:32 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:33.071135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e30461-5499-4564-85d3-3c8735e8ac80 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.071727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0f67e-eb65-4877-8916-f67274cacbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.072436 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0f67e-eb65-4877-8916-f67274cacbc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.072744 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0f67e-eb65-4877-8916-f67274cacbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.073046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0f67e-eb65-4877-8916-f67274cacbc3 admin admin] PATH_INFO: `/v3/projects/d88cbefc7cae443f9cf38579774a9630/users/de4a42a71db84287b40f92668c9f540b/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.089154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0f67e-eb65-4877-8916-f67274cacbc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88cbefc7cae443f9cf38579774a9630, user_id=de4a42a71db84287b40f92668c9f540b, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.091914 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0f67e-eb65-4877-8916-f67274cacbc3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.133135 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e30461-5499-4564-85d3-3c8735e8ac80 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.138553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684793-63de-43ba-b521-1d417ced7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.142513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684793-63de-43ba-b521-1d417ced7d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.142513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684793-63de-43ba-b521-1d417ced7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.142513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1684793-63de-43ba-b521-1d417ced7d21 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.142513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1684793-63de-43ba-b521-1d417ced7d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.142513 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1684793-63de-43ba-b521-1d417ced7d21 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.215092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1424/2846] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:33 2022] PUT /identity/v3/projects/d88cbefc7cae443f9cf38579774a9630/users/de4a42a71db84287b40f92668c9f540b/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:33.215299 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1422/2846] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:30:33 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:30:33.219312 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684793-63de-43ba-b521-1d417ced7d21 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.221932 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0f67e-eb65-4877-8916-f67274cacbc3 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.229044 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1684793-63de-43ba-b521-1d417ced7d21 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.283318 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0f67e-eb65-4877-8916-f67274cacbc3 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.285041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dbb22-628c-40de-95ae-2d5c49c8a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.285731 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dbb22-628c-40de-95ae-2d5c49c8a54d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.286011 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dbb22-628c-40de-95ae-2d5c49c8a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.286284 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dbb22-628c-40de-95ae-2d5c49c8a54d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.286947 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dbb22-628c-40de-95ae-2d5c49c8a54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.288364 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7a0e7-4794-4f5d-85cd-223b747cb29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.288542 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19dbb22-628c-40de-95ae-2d5c49c8a54d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.288975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7a0e7-4794-4f5d-85cd-223b747cb29c admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.289257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7a0e7-4794-4f5d-85cd-223b747cb29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.289533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7a0e7-4794-4f5d-85cd-223b747cb29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.290220 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7a0e7-4794-4f5d-85cd-223b747cb29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.292093 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7a0e7-4794-4f5d-85cd-223b747cb29c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.301294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1423/2847] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:33.302352 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dbb22-628c-40de-95ae-2d5c49c8a54d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.302727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1425/2848] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 11:30:33.306750 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7a0e7-4794-4f5d-85cd-223b747cb29c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.312934 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dbb22-628c-40de-95ae-2d5c49c8a54d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.317194 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7a0e7-4794-4f5d-85cd-223b747cb29c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.318883 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145c695-f6f3-4254-9fea-dc1d8cbf4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.319552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c695-f6f3-4254-9fea-dc1d8cbf4770 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.319833 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c695-f6f3-4254-9fea-dc1d8cbf4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.320110 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c695-f6f3-4254-9fea-dc1d8cbf4770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.320797 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145c695-f6f3-4254-9fea-dc1d8cbf4770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.322473 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145c695-f6f3-4254-9fea-dc1d8cbf4770 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.323843 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d2d9-51cb-498c-bfc2-c062458b1bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.324511 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d2d9-51cb-498c-bfc2-c062458b1bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.324803 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d2d9-51cb-498c-bfc2-c062458b1bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.325073 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d2d9-51cb-498c-bfc2-c062458b1bc2 admin admin] PATH_INFO: `/v3/projects/d88cbefc7cae443f9cf38579774a9630/users/de4a42a71db84287b40f92668c9f540b/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.326998 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d2d9-51cb-498c-bfc2-c062458b1bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88cbefc7cae443f9cf38579774a9630, user_id=de4a42a71db84287b40f92668c9f540b, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.329697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d2d9-51cb-498c-bfc2-c062458b1bc2 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.333940 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1424/2849] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:30:33.338206 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145c695-f6f3-4254-9fea-dc1d8cbf4770 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.341157 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1426/2850] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:33 2022] PUT /identity/v3/projects/d88cbefc7cae443f9cf38579774a9630/users/de4a42a71db84287b40f92668c9f540b/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:30:33.348726 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145c695-f6f3-4254-9fea-dc1d8cbf4770 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.351384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26ea7-7766-4ba9-8dff-6aa1f89eea0c None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.351846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26ea7-7766-4ba9-8dff-6aa1f89eea0c None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.352130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26ea7-7766-4ba9-8dff-6aa1f89eea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.381328 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-5ff26ea7-7766-4ba9-8dff-6aa1f89eea0c None None] MFA Rules not processed for user `de4a42a71db84287b40f92668c9f540b`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:33.383238 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5ff26ea7-7766-4ba9-8dff-6aa1f89eea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:33.407479 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b15e6-611f-462b-bb6c-540b8c09c612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.408148 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b15e6-611f-462b-bb6c-540b8c09c612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.408467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b15e6-611f-462b-bb6c-540b8c09c612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.410459 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b15e6-611f-462b-bb6c-540b8c09c612 admin admin] PATH_INFO: `/v3/projects/8f01367fbeba4faca51c16e7749fb8b4/users/439c47e7e42c4d6e9434af07811a5dba/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.414136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:33.423864 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b15e6-611f-462b-bb6c-540b8c09c612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f01367fbeba4faca51c16e7749fb8b4, user_id=439c47e7e42c4d6e9434af07811a5dba, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.427072 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b15e6-611f-462b-bb6c-540b8c09c612 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.456129 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1427/2851] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:33.467569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff26ea7-7766-4ba9-8dff-6aa1f89eea0c None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.468892 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-5ff26ea7-7766-4ba9-8dff-6aa1f89eea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:33.525115 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff26ea7-7766-4ba9-8dff-6aa1f89eea0c None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.528756 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.529356 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.529641 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.529913 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.546403 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1425/2852] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:30:33 2022] PUT /identity/v3/projects/8f01367fbeba4faca51c16e7749fb8b4/users/439c47e7e42c4d6e9434af07811a5dba/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:33.557751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb3f8-29cc-4cbc-87e3-7b1396f164b2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.558036 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb3f8-29cc-4cbc-87e3-7b1396f164b2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.558311 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdb3f8-29cc-4cbc-87e3-7b1396f164b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.587703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4ccdb3f8-29cc-4cbc-87e3-7b1396f164b2 None None] MFA Rules not processed for user `439c47e7e42c4d6e9434af07811a5dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:33.588991 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4ccdb3f8-29cc-4cbc-87e3-7b1396f164b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:33.590997 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.592476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.601569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1428/2853] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 11:30:33.634265 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:33.659282 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1426/2854] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:33.684763 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:33.686230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:33.700136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af28d-bfc3-440e-af23-830af93903d0 service cinder] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:33.755069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821d966-a92f-4398-b65f-786fe52ffdca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:33.755069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821d966-a92f-4398-b65f-786fe52ffdca service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:33.755069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821d966-a92f-4398-b65f-786fe52ffdca service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:33.755069 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821d966-a92f-4398-b65f-786fe52ffdca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:33.762740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821d966-a92f-4398-b65f-786fe52ffdca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:33.764217 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821d966-a92f-4398-b65f-786fe52ffdca service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:33.773952 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1429/2855] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:36.951784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdb3f8-29cc-4cbc-87e3-7b1396f164b2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:37.069003 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdb3f8-29cc-4cbc-87e3-7b1396f164b2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:37.073909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:37.074544 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:37.074831 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:37.075204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] PATH_INFO: `/v3/users/880b09b5fa3747a1a2836ea4a7c563ba` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:37.076587 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=880b09b5fa3747a1a2836ea4a7c563ba)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:37.079454 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:37.243032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:37.257323 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880b09b5fa3747a1a2836ea4a7c563ba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:37.258006 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880b09b5fa3747a1a2836ea4a7c563ba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:37.352826 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880b09b5fa3747a1a2836ea4a7c563ba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:37.360557 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880b09b5fa3747a1a2836ea4a7c563ba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:37.372545 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880b09b5fa3747a1a2836ea4a7c563ba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:37.379138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1427/2856] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:36 2022] DELETE /identity/v3/users/880b09b5fa3747a1a2836ea4a7c563ba => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:37.383547 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ee82-9a16-48cf-8d46-d8dbd60059d1 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:37.384047 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ee82-9a16-48cf-8d46-d8dbd60059d1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:37.384175 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ee82-9a16-48cf-8d46-d8dbd60059d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:37.418833 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=100 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:37.440033 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-fb45ee82-9a16-48cf-8d46-d8dbd60059d1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:37.441270 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fb45ee82-9a16-48cf-8d46-d8dbd60059d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:37.505734 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1430/2857] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 11:30:37.522552 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:37.525246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:37.632728 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f89f2-916a-4259-b275-d1280ce587fa admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:37.636760 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f585d-c18e-46cb-84c3-30850f20d881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:37.640488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f585d-c18e-46cb-84c3-30850f20d881 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:37.640488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f585d-c18e-46cb-84c3-30850f20d881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:37.640488 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f585d-c18e-46cb-84c3-30850f20d881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:37.652771 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f585d-c18e-46cb-84c3-30850f20d881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:37.654538 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f585d-c18e-46cb-84c3-30850f20d881 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:37.664718 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1428/2858] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:38.165288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45ee82-9a16-48cf-8d46-d8dbd60059d1 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:38.165288 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-fb45ee82-9a16-48cf-8d46-d8dbd60059d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:38.178449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45ee82-9a16-48cf-8d46-d8dbd60059d1 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:38.184708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:38.188019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:38.188019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:38.188019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] PATH_INFO: `/v3/projects/e8de0ade51414ed2b9df9609c1d818e2` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:38.188019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8de0ade51414ed2b9df9609c1d818e2)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:38.189271 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:38.321298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8de0ade51414ed2b9df9609c1d818e2', 'request_id': 'req-4419a237-bc31-4059-a6d9-35d783f9d9ca'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.328143 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8de0ade51414ed2b9df9609c1d818e2', 'request_id': 'req-4419a237-bc31-4059-a6d9-35d783f9d9ca'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.333708 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8de0ade51414ed2b9df9609c1d818e2', 'request_id': 'req-4419a237-bc31-4059-a6d9-35d783f9d9ca'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.417517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] The token cache is being invalidate because project e8de0ade51414ed2b9df9609c1d818e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:38.417517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.417517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.417517 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1431/2859] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:38 2022] DELETE /identity/v3/projects/e8de0ade51414ed2b9df9609c1d818e2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:38.420120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f585d-c18e-46cb-84c3-30850f20d881 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:38.433449 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f585d-c18e-46cb-84c3-30850f20d881 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:38.493686 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:38.494316 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:38.494594 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:38.494862 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] PATH_INFO: `/v3/users/de4a42a71db84287b40f92668c9f540b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:38.496226 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4a42a71db84287b40f92668c9f540b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:38.498201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:38.708086 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:38.716958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4a42a71db84287b40f92668c9f540b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.717653 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4a42a71db84287b40f92668c9f540b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.791913 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4a42a71db84287b40f92668c9f540b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.802121 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4a42a71db84287b40f92668c9f540b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.821723 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4a42a71db84287b40f92668c9f540b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:38.827815 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1429/2860] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:38 2022] DELETE /identity/v3/users/de4a42a71db84287b40f92668c9f540b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:39.325214 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:39.326299 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:39.345727 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419a237-bc31-4059-a6d9-35d783f9d9ca admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:39.409922 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:39.410573 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:39.410851 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:39.411165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] PATH_INFO: `/v3/projects/d88cbefc7cae443f9cf38579774a9630` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:39.412384 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88cbefc7cae443f9cf38579774a9630)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:39.414386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:39.441449 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:39.551523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88cbefc7cae443f9cf38579774a9630', 'request_id': 'req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:39.551523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88cbefc7cae443f9cf38579774a9630', 'request_id': 'req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:39.556896 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88cbefc7cae443f9cf38579774a9630', 'request_id': 'req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:39.607665 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] The token cache is being invalidate because project d88cbefc7cae443f9cf38579774a9630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:39.607950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:39.608618 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-86bc6f33-1e95-4fef-9f25-5c1b7e6807b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:39.610165 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1432/2861] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:39 2022] DELETE /identity/v3/projects/d88cbefc7cae443f9cf38579774a9630 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:48.895032 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:49.603504 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:51.974679 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:51.976077 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:51.990210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bd57c-286b-4962-8998-a96dfa758214 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:52.047721 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:52.048395 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:52.048680 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:52.048985 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] PATH_INFO: `/v3/users/1e1e463f18e94c608b0b60186d821411` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:52.050179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1e463f18e94c608b0b60186d821411)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:52.052708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:52.213416 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1e463f18e94c608b0b60186d821411'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:52.214064 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1e463f18e94c608b0b60186d821411'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:52.304645 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1e463f18e94c608b0b60186d821411'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:52.313177 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1e463f18e94c608b0b60186d821411'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:52.326475 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1e463f18e94c608b0b60186d821411'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:52.332905 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1430/2862] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:30:51 2022] DELETE /identity/v3/users/1e1e463f18e94c608b0b60186d821411 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:30:52.337626 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23abaac-19ea-447a-a5ee-685f0b1c224d None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:52.338323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23abaac-19ea-447a-a5ee-685f0b1c224d None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:52.338323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23abaac-19ea-447a-a5ee-685f0b1c224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:52.358990 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f23abaac-19ea-447a-a5ee-685f0b1c224d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:30:52.360201 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f23abaac-19ea-447a-a5ee-685f0b1c224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:52.424418 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1433/2863] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:30:52.435010 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:52.436444 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:52.494889 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97686e4-3bd2-4bdd-bd2d-3d2dfe6d7fbe admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:52.498386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:52.498987 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:52.499267 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:52.499539 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:52.508963 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:52.510415 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:52.520673 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1431/2864] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:30:52.919225 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23abaac-19ea-447a-a5ee-685f0b1c224d None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:30:52.920725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f23abaac-19ea-447a-a5ee-685f0b1c224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:30:52.935864 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23abaac-19ea-447a-a5ee-685f0b1c224d None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:30:52.939690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:30:52.940468 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:30:52.940968 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:30:52.941334 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] PATH_INFO: `/v3/projects/85b307a0fede4457a30c54a0edc4f34b` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:30:52.943353 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b307a0fede4457a30c54a0edc4f34b)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:30:52.945375 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:30:53.042148 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b307a0fede4457a30c54a0edc4f34b', 'request_id': 'req-2b4622d5-b922-4183-a430-1ccb1806dba4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:53.048697 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b307a0fede4457a30c54a0edc4f34b', 'request_id': 'req-2b4622d5-b922-4183-a430-1ccb1806dba4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:53.055038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b307a0fede4457a30c54a0edc4f34b', 'request_id': 'req-2b4622d5-b922-4183-a430-1ccb1806dba4'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:53.128484 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] The token cache is being invalidate because project 85b307a0fede4457a30c54a0edc4f34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:30:53.128782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:53.130041 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-2b4622d5-b922-4183-a430-1ccb1806dba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:30:53.131520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1434/2865] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:30:52 2022] DELETE /identity/v3/projects/85b307a0fede4457a30c54a0edc4f34b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 11:31:02.515740 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:03.125142 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:07.687288 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:07.688744 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:07.701907 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931ac6-b45c-4355-b3d4-4ecd250ef321 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:07.758212 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:07.758832 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:07.759112 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:07.759381 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] PATH_INFO: `/v3/users/439c47e7e42c4d6e9434af07811a5dba` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:07.760518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] RBAC: Authorizing `identity:delete_user(user_id=439c47e7e42c4d6e9434af07811a5dba)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:07.762397 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:07.948391 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439c47e7e42c4d6e9434af07811a5dba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:07.948975 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439c47e7e42c4d6e9434af07811a5dba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.012622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439c47e7e42c4d6e9434af07811a5dba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.019769 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439c47e7e42c4d6e9434af07811a5dba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.032097 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439c47e7e42c4d6e9434af07811a5dba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.038191 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1432/2866] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:31:07 2022] DELETE /identity/v3/users/439c47e7e42c4d6e9434af07811a5dba => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:31:08.042691 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c15b57-3eba-441b-8d7e-ee531918c912 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:08.043185 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c15b57-3eba-441b-8d7e-ee531918c912 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:08.043287 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c15b57-3eba-441b-8d7e-ee531918c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:08.062189 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-d2c15b57-3eba-441b-8d7e-ee531918c912 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:08.063481 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d2c15b57-3eba-441b-8d7e-ee531918c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:08.121457 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1435/2867] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:08.131570 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:08.133084 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:08.211434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4d1c-7859-47b2-8afe-f640bf30118e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:08.214966 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61630c11-8f59-41ec-bbc4-bbab208cafd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:08.215569 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61630c11-8f59-41ec-bbc4-bbab208cafd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:08.215851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61630c11-8f59-41ec-bbc4-bbab208cafd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:08.216130 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61630c11-8f59-41ec-bbc4-bbab208cafd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:08.225430 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61630c11-8f59-41ec-bbc4-bbab208cafd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:08.226861 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61630c11-8f59-41ec-bbc4-bbab208cafd8 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:08.236366 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1433/2868] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:31:08.654179 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c15b57-3eba-441b-8d7e-ee531918c912 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:08.655736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-d2c15b57-3eba-441b-8d7e-ee531918c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:08.670907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c15b57-3eba-441b-8d7e-ee531918c912 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:08.675690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:08.677087 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:08.677351 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:08.677613 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] PATH_INFO: `/v3/projects/8f01367fbeba4faca51c16e7749fb8b4` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:08.678809 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f01367fbeba4faca51c16e7749fb8b4)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:08.680746 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:08.779000 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f01367fbeba4faca51c16e7749fb8b4', 'request_id': 'req-f1d8e73d-7a6f-4413-9d51-c27fe224193d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.785166 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f01367fbeba4faca51c16e7749fb8b4', 'request_id': 'req-f1d8e73d-7a6f-4413-9d51-c27fe224193d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.790601 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f01367fbeba4faca51c16e7749fb8b4', 'request_id': 'req-f1d8e73d-7a6f-4413-9d51-c27fe224193d'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.875385 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] The token cache is being invalidate because project 8f01367fbeba4faca51c16e7749fb8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:31:08.875676 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.876323 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-f1d8e73d-7a6f-4413-9d51-c27fe224193d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:08.877848 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1436/2869] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:31:08 2022] DELETE /identity/v3/projects/8f01367fbeba4faca51c16e7749fb8b4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:31:08.883805 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07ee8-1543-4f51-8152-ec5219d2afa9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:08.884342 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07ee8-1543-4f51-8152-ec5219d2afa9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:08.884445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e07ee8-1543-4f51-8152-ec5219d2afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:08.889176 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:08.932291 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-28e07ee8-1543-4f51-8152-ec5219d2afa9 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:08.933501 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-28e07ee8-1543-4f51-8152-ec5219d2afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:08.990870 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1434/2870] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:08.998431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e297-67f0-40d8-a8c9-0ffddc0443d1 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:08.998719 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e297-67f0-40d8-a8c9-0ffddc0443d1 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:08.998994 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e297-67f0-40d8-a8c9-0ffddc0443d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.018872 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-3b31e297-67f0-40d8-a8c9-0ffddc0443d1 None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:09.020257 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-3b31e297-67f0-40d8-a8c9-0ffddc0443d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:09.028337 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1437/2871] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:09.032337 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07ee8-1543-4f51-8152-ec5219d2afa9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:09.042421 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e07ee8-1543-4f51-8152-ec5219d2afa9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:09.046881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:09.047474 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:09.047751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:09.048019 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.048702 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:31:09.049004 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:09.050573 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:09.062409 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1435/2872] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:31:09.066461 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e297-67f0-40d8-a8c9-0ffddc0443d1 None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:09.075771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e297-67f0-40d8-a8c9-0ffddc0443d1 None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:09.080359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2b821-4095-4143-be0b-93c8637421a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:09.080948 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2b821-4095-4143-be0b-93c8637421a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:09.081229 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2b821-4095-4143-be0b-93c8637421a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:09.081562 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2b821-4095-4143-be0b-93c8637421a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.082191 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2b821-4095-4143-be0b-93c8637421a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:09.084224 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2b821-4095-4143-be0b-93c8637421a7 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:09.170310 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1438/2873] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:31:09 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:31:09.174543 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:09.185220 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b524a5a-6263-4418-a3d0-5d08c1fba107 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:09.240703 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2384-40b8-4187-8997-2361a36b7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:09.241302 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2384-40b8-4187-8997-2361a36b7785 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:09.241578 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2384-40b8-4187-8997-2361a36b7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:09.241848 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2384-40b8-4187-8997-2361a36b7785 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.242472 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c2384-40b8-4187-8997-2361a36b7785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:09.244386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c2384-40b8-4187-8997-2361a36b7785 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:09.340807 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1436/2874] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:31:09 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 11:31:09.344807 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2b821-4095-4143-be0b-93c8637421a7 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:09.356009 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2b821-4095-4143-be0b-93c8637421a7 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:09.360566 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ca193-fe76-459a-a21d-47a6d513d0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:09.361159 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ca193-fe76-459a-a21d-47a6d513d0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:09.361435 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ca193-fe76-459a-a21d-47a6d513d0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:09.361702 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ca193-fe76-459a-a21d-47a6d513d0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.362386 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ca193-fe76-459a-a21d-47a6d513d0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:09.364765 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ca193-fe76-459a-a21d-47a6d513d0f5 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:09.374598 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1439/2875] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:31:09.378512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2384-40b8-4187-8997-2361a36b7785 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:09.388764 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2384-40b8-4187-8997-2361a36b7785 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:09.393428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f5408-f075-4902-b721-330999e39654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:09.394026 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5408-f075-4902-b721-330999e39654 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:09.394308 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5408-f075-4902-b721-330999e39654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:09.394588 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5408-f075-4902-b721-330999e39654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.395924 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f5408-f075-4902-b721-330999e39654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:09.397791 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f5408-f075-4902-b721-330999e39654 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:09.408103 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1437/2876] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:31:09.412709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ca193-fe76-459a-a21d-47a6d513d0f5 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:09.422541 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ca193-fe76-459a-a21d-47a6d513d0f5 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:09.427088 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:09.427720 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:09.428001 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:09.428278 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] PATH_INFO: `/v3/projects/f1147f76ae68410c8e1768b138c53535/users/6c2123f47dab4a63901ffbdd777c75c6/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.442211 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1147f76ae68410c8e1768b138c53535, user_id=6c2123f47dab4a63901ffbdd777c75c6, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:09.444874 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:09.515770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1440/2877] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:31:09 2022] PUT /identity/v3/projects/f1147f76ae68410c8e1768b138c53535/users/6c2123f47dab4a63901ffbdd777c75c6/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:31:09.526939 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eba8c-b332-451e-b758-4faba2cfe1d5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:09.527229 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eba8c-b332-451e-b758-4faba2cfe1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:09.527508 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eba8c-b332-451e-b758-4faba2cfe1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.555063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0a2eba8c-b332-451e-b758-4faba2cfe1d5 None None] MFA Rules not processed for user `6c2123f47dab4a63901ffbdd777c75c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:09.556266 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0a2eba8c-b332-451e-b758-4faba2cfe1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:09.587958 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:09.619246 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1438/2878] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:09.630137 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:09.631812 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:09.657826 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:09.713306 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b96b3-e840-4b75-a7ac-0c198b97acc8 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:09.717577 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f8775-5c7b-4540-be0b-3117a52e75d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65afb6f35528480591f2411976470d84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:09.718200 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f8775-5c7b-4540-be0b-3117a52e75d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:09.718463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f8775-5c7b-4540-be0b-3117a52e75d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:09.718736 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f8775-5c7b-4540-be0b-3117a52e75d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:09.727557 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f8775-5c7b-4540-be0b-3117a52e75d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:09.729038 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f8775-5c7b-4540-be0b-3117a52e75d1 service cinder] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:09.737587 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1441/2879] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:31:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:31:19.631357 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=12 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:19.744261 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=26 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:21.016823 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eba8c-b332-451e-b758-4faba2cfe1d5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:21.078507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eba8c-b332-451e-b758-4faba2cfe1d5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:21.082909 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:21.083536 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:21.083841 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:21.084115 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] PATH_INFO: `/v3/users/6c2123f47dab4a63901ffbdd777c75c6` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:21.085258 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2123f47dab4a63901ffbdd777c75c6)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:21.087161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:21.255289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2123f47dab4a63901ffbdd777c75c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:21.256094 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2123f47dab4a63901ffbdd777c75c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:21.334104 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2123f47dab4a63901ffbdd777c75c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:21.341359 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2123f47dab4a63901ffbdd777c75c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:21.353496 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2123f47dab4a63901ffbdd777c75c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:21.359440 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1439/2880] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:31:21 2022] DELETE /identity/v3/users/6c2123f47dab4a63901ffbdd777c75c6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:31:21.363966 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb821-ad37-4fda-8e7c-c691d626b87b None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:21.365321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb821-ad37-4fda-8e7c-c691d626b87b None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:21.365321 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb821-ad37-4fda-8e7c-c691d626b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:21.384178 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-31bdb821-ad37-4fda-8e7c-c691d626b87b None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:21.387264 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-31bdb821-ad37-4fda-8e7c-c691d626b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:21.443740 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1442/2881] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:21.453356 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:21.454779 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:21.512370 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a50bc2-71f2-4c0c-91e6-3c5d0626abf4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:21.516002 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891764c-3902-4b32-8de9-772d723e2b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:21.516646 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891764c-3902-4b32-8de9-772d723e2b80 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:21.516926 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891764c-3902-4b32-8de9-772d723e2b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:21.517201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891764c-3902-4b32-8de9-772d723e2b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:21.526901 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891764c-3902-4b32-8de9-772d723e2b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:21.528338 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891764c-3902-4b32-8de9-772d723e2b80 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:21.538207 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1440/2882] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:31:21.957222 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdb821-ad37-4fda-8e7c-c691d626b87b None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:21.958771 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-31bdb821-ad37-4fda-8e7c-c691d626b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:21.971507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdb821-ad37-4fda-8e7c-c691d626b87b None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:21.976894 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:21.977599 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:21.977883 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:21.978161 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] PATH_INFO: `/v3/projects/f1147f76ae68410c8e1768b138c53535` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:21.979355 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1147f76ae68410c8e1768b138c53535)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:21.981325 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:22.074695 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1147f76ae68410c8e1768b138c53535', 'request_id': 'req-c8062523-9006-476b-a70e-b18dfa6e66b3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:22.080770 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1147f76ae68410c8e1768b138c53535', 'request_id': 'req-c8062523-9006-476b-a70e-b18dfa6e66b3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:22.086216 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1147f76ae68410c8e1768b138c53535', 'request_id': 'req-c8062523-9006-476b-a70e-b18dfa6e66b3'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:22.149824 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] The token cache is being invalidate because project f1147f76ae68410c8e1768b138c53535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80613) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:31:22.150114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:22.150768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c8062523-9006-476b-a70e-b18dfa6e66b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:31:22.152241 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1443/2883] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:31:21 2022] DELETE /identity/v3/projects/f1147f76ae68410c8e1768b138c53535 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:31:22.157127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4980f4-2b18-4bdb-bef6-d519ad9ddddb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.160161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4980f4-2b18-4bdb-bef6-d519ad9ddddb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.160161 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4980f4-2b18-4bdb-bef6-d519ad9ddddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.177457 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ea4980f4-2b18-4bdb-bef6-d519ad9ddddb None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:22.178784 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ea4980f4-2b18-4bdb-bef6-d519ad9ddddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:22.196296 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:22.238257 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1441/2884] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:22.246285 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12eac-fa1e-4026-a74f-27a2fa66f9cf None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.246581 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12eac-fa1e-4026-a74f-27a2fa66f9cf None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.250358 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12eac-fa1e-4026-a74f-27a2fa66f9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.266830 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-6ca12eac-fa1e-4026-a74f-27a2fa66f9cf None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:22.268028 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-6ca12eac-fa1e-4026-a74f-27a2fa66f9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:22.277396 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1444/2885] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:22.281614 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4980f4-2b18-4bdb-bef6-d519ad9ddddb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:22.291776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4980f4-2b18-4bdb-bef6-d519ad9ddddb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:22.296428 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:22.297041 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.297309 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.297580 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.298230 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 11:31:22.298532 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:22.300105 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:22.312736 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1442/2886] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 10 11:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 11:31:22.316940 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca12eac-fa1e-4026-a74f-27a2fa66f9cf None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:22.326725 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca12eac-fa1e-4026-a74f-27a2fa66f9cf None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:22.331518 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e53f8-36e5-4f30-ad5a-00b5cab5ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:22.332119 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e53f8-36e5-4f30-ad5a-00b5cab5ca70 admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.332431 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e53f8-36e5-4f30-ad5a-00b5cab5ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.332707 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e53f8-36e5-4f30-ad5a-00b5cab5ca70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.334174 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e53f8-36e5-4f30-ad5a-00b5cab5ca70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:22.336082 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e53f8-36e5-4f30-ad5a-00b5cab5ca70 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:22.437975 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1445/2887] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:31:22 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:31:22.442999 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:22.452858 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7cb77-9ef9-4322-a67d-e03c79d31caf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:22.509045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4cb4-939c-4977-bfbf-8ca5b0e88933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:22.509575 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4cb4-939c-4977-bfbf-8ca5b0e88933 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.509854 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4cb4-939c-4977-bfbf-8ca5b0e88933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.510125 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4cb4-939c-4977-bfbf-8ca5b0e88933 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.510746 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b4cb4-939c-4977-bfbf-8ca5b0e88933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:22.512670 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b4cb4-939c-4977-bfbf-8ca5b0e88933 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:22.620132 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1443/2888] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:31:22 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:31:22.624202 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e53f8-36e5-4f30-ad5a-00b5cab5ca70 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:22.634548 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e53f8-36e5-4f30-ad5a-00b5cab5ca70 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:22.639121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b76eba-4ec3-44e2-8feb-707c0f2715ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:22.639716 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b76eba-4ec3-44e2-8feb-707c0f2715ef admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.639996 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b76eba-4ec3-44e2-8feb-707c0f2715ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.640267 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b76eba-4ec3-44e2-8feb-707c0f2715ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.640935 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b76eba-4ec3-44e2-8feb-707c0f2715ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:22.642524 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b76eba-4ec3-44e2-8feb-707c0f2715ef admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:22.652410 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1446/2889] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:31:22.656172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4cb4-939c-4977-bfbf-8ca5b0e88933 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:22.666523 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4cb4-939c-4977-bfbf-8ca5b0e88933 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:22.671233 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d74bf-3970-4182-9d2f-92cb80c5a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:22.671834 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d74bf-3970-4182-9d2f-92cb80c5a1be admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.672143 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d74bf-3970-4182-9d2f-92cb80c5a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.672465 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d74bf-3970-4182-9d2f-92cb80c5a1be admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.673138 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d74bf-3970-4182-9d2f-92cb80c5a1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:22.674716 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d74bf-3970-4182-9d2f-92cb80c5a1be admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:22.685160 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1444/2890] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:31:22.689006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b76eba-4ec3-44e2-8feb-707c0f2715ef admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:22.699090 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b76eba-4ec3-44e2-8feb-707c0f2715ef admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:22.703731 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:22.704404 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] REQUEST_METHOD: `PUT` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.704689 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.704964 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] PATH_INFO: `/v3/projects/0a1815ba253a4f1592e57f7f933813c5/users/74eb7449794e4995a24027b10bb8a4e5/roles/7d605c5d717e4621bdfa8a6bc3da9a0a` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.718992 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1815ba253a4f1592e57f7f933813c5, user_id=74eb7449794e4995a24027b10bb8a4e5, role_id=7d605c5d717e4621bdfa8a6bc3da9a0a)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:22.721654 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:22.785950 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1447/2891] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:31:22 2022] PUT /identity/v3/projects/0a1815ba253a4f1592e57f7f933813c5/users/74eb7449794e4995a24027b10bb8a4e5/roles/7d605c5d717e4621bdfa8a6bc3da9a0a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:31:22.791873 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b311e-656d-47e9-a9b4-0961a09f076d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.792163 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b311e-656d-47e9-a9b4-0961a09f076d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.792485 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b311e-656d-47e9-a9b4-0961a09f076d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.812671 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-495b311e-656d-47e9-a9b4-0961a09f076d None None] MFA Rules not processed for user `54c3d35f7ad34e87bf733354f4b0f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:22.813881 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-495b311e-656d-47e9-a9b4-0961a09f076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:22.877507 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1445/2892] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:22.887666 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:22.889576 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:22.912497 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:22.946821 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca7b1d-5cef-4ec6-b412-38bedff7442c admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:22.950530 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee66d8-badb-4c9d-afe3-1fd9b5b38da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:22.951130 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee66d8-badb-4c9d-afe3-1fd9b5b38da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:22.951414 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee66d8-badb-4c9d-afe3-1fd9b5b38da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:22.951683 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee66d8-badb-4c9d-afe3-1fd9b5b38da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:22.961242 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee66d8-badb-4c9d-afe3-1fd9b5b38da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:22.962658 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee66d8-badb-4c9d-afe3-1fd9b5b38da6 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:22.972260 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1448/2893] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:31:28.049827 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b804cd8-a8dc-42b3-94c5-9f216ad078dd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:28.050386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b804cd8-a8dc-42b3-94c5-9f216ad078dd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:28.050386 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b804cd8-a8dc-42b3-94c5-9f216ad078dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:28.080676 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1b804cd8-a8dc-42b3-94c5-9f216ad078dd None None] MFA Rules not processed for user `74eb7449794e4995a24027b10bb8a4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:28.081895 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1b804cd8-a8dc-42b3-94c5-9f216ad078dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:28.103540 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:28.154270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1446/2894] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:28.158779 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee66d8-badb-4c9d-afe3-1fd9b5b38da6 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:28.168871 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee66d8-badb-4c9d-afe3-1fd9b5b38da6 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:28.173476 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fe07e-feb8-4ffd-95e6-d38c0378857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:28.174289 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fe07e-feb8-4ffd-95e6-d38c0378857b admin admin] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:28.174564 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fe07e-feb8-4ffd-95e6-d38c0378857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:28.174837 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fe07e-feb8-4ffd-95e6-d38c0378857b admin admin] PATH_INFO: `/v3/projects` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:28.175462 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fe07e-feb8-4ffd-95e6-d38c0378857b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:28.177388 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fe07e-feb8-4ffd-95e6-d38c0378857b admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:28.276259 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1449/2895] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 10 11:31:28 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:31:28.279503 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b804cd8-a8dc-42b3-94c5-9f216ad078dd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:28.289321 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b804cd8-a8dc-42b3-94c5-9f216ad078dd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:28.344995 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def68b8-c0c1-47d0-ba2a-9acc8ed7f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:28.345608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def68b8-c0c1-47d0-ba2a-9acc8ed7f8fe admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:28.345885 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def68b8-c0c1-47d0-ba2a-9acc8ed7f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:28.346154 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def68b8-c0c1-47d0-ba2a-9acc8ed7f8fe admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:28.346799 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def68b8-c0c1-47d0-ba2a-9acc8ed7f8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:28.348793 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def68b8-c0c1-47d0-ba2a-9acc8ed7f8fe admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:28.436425 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1447/2896] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 10 11:31:28 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 11:31:28.440552 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fe07e-feb8-4ffd-95e6-d38c0378857b admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:28.451379 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fe07e-feb8-4ffd-95e6-d38c0378857b admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:28.455710 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b097e-721f-4664-a842-e9193f134571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:28.456450 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b097e-721f-4664-a842-e9193f134571 admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:28.456856 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b097e-721f-4664-a842-e9193f134571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:28.457135 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b097e-721f-4664-a842-e9193f134571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:28.457789 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b097e-721f-4664-a842-e9193f134571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:28.460766 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b097e-721f-4664-a842-e9193f134571 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:28.472960 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1450/2897] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:31:28.478053 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def68b8-c0c1-47d0-ba2a-9acc8ed7f8fe admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:28.488694 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def68b8-c0c1-47d0-ba2a-9acc8ed7f8fe admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:28.493517 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52670c8-e007-468d-add5-1ff63176e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:28.494190 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52670c8-e007-468d-add5-1ff63176e18b admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:28.494468 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52670c8-e007-468d-add5-1ff63176e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:28.494739 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52670c8-e007-468d-add5-1ff63176e18b admin admin] PATH_INFO: `/v3/projects/6efef4a4333f4472966bfafd148e44f1/users/d70d74094f904033a0e8f3dfd5b168e1/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:28.511396 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52670c8-e007-468d-add5-1ff63176e18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efef4a4333f4472966bfafd148e44f1, user_id=d70d74094f904033a0e8f3dfd5b168e1, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:28.514196 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52670c8-e007-468d-add5-1ff63176e18b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:28.614553 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1448/2898] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:31:28 2022] PUT /identity/v3/projects/6efef4a4333f4472966bfafd148e44f1/users/d70d74094f904033a0e8f3dfd5b168e1/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:31:28.618692 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b097e-721f-4664-a842-e9193f134571 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:28.629361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b097e-721f-4664-a842-e9193f134571 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:28.685533 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d63046-df10-43d0-90cd-5a524ee3783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:28.686136 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63046-df10-43d0-90cd-5a524ee3783e admin admin] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:28.686419 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63046-df10-43d0-90cd-5a524ee3783e admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:28.686687 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d63046-df10-43d0-90cd-5a524ee3783e admin admin] PATH_INFO: `/v3/roles` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:28.687324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d63046-df10-43d0-90cd-5a524ee3783e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:28.688961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d63046-df10-43d0-90cd-5a524ee3783e admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:28.699860 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1451/2899] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 10 11:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 11:31:28.703949 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52670c8-e007-468d-add5-1ff63176e18b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:28.714656 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52670c8-e007-468d-add5-1ff63176e18b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:28.719201 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:28.719851 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:28.720126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:28.720424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] PATH_INFO: `/v3/projects/6efef4a4333f4472966bfafd148e44f1/users/d70d74094f904033a0e8f3dfd5b168e1/roles/b5150972b0fa4b60a278cc67fd0ce6e8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:28.722294 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6efef4a4333f4472966bfafd148e44f1, user_id=d70d74094f904033a0e8f3dfd5b168e1, role_id=b5150972b0fa4b60a278cc67fd0ce6e8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:28.725525 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:28.735608 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1449/2900] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 10 11:31:28 2022] PUT /identity/v3/projects/6efef4a4333f4472966bfafd148e44f1/users/d70d74094f904033a0e8f3dfd5b168e1/roles/b5150972b0fa4b60a278cc67fd0ce6e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:31:34.228246 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b73b0-dcb2-4c6c-879c-665d2a7b31d6 None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:34.228846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b73b0-dcb2-4c6c-879c-665d2a7b31d6 None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:34.228846 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b73b0-dcb2-4c6c-879c-665d2a7b31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:34.256955 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-f25b73b0-dcb2-4c6c-879c-665d2a7b31d6 None None] MFA Rules not processed for user `d70d74094f904033a0e8f3dfd5b168e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:34.258170 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f25b73b0-dcb2-4c6c-879c-665d2a7b31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:34.326621 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1452/2901] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:34.342910 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:34.344719 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:34.416147 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:34.450038 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb30ab-826d-49fd-bd1c-0245a08c7986 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:34.455405 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:34.456007 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:34.456287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:34.456622 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:34.511548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:34.513287 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:34.522445 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1450/2902] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:31:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:31:37.141852 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fb6d1-b409-49cf-9c60-c688af6765fa None None] REQUEST_METHOD: `POST` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:37.142361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fb6d1-b409-49cf-9c60-c688af6765fa None None] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:37.142463 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fb6d1-b409-49cf-9c60-c688af6765fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:37.164062 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.auth.core [None req-b32fb6d1-b409-49cf-9c60-c688af6765fa None None] MFA Rules not processed for user `74eb7449794e4995a24027b10bb8a4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80613) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 11:31:37.165441 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-b32fb6d1-b409-49cf-9c60-c688af6765fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:37.174709 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1453/2903] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 10 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 11:31:44.540548 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=36 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:47.157415 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:48.404839 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:31:48.406248 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:48.494830 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0de96-b43f-41e0-b53f-3ca7c15b1f06 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:31:48.500271 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:31:48.501258 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:31:48.501534 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:31:48.502111 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:31:48.503546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:31:48.515073 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:31:48.516667 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:31:48.527385 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1451/2904] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:31:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:31:58.522434 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=41 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:04.757006 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fb6d1-b409-49cf-9c60-c688af6765fa None None] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:32:04.812767 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fb6d1-b409-49cf-9c60-c688af6765fa None None] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:32:04.816359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3d18b-fc07-45c7-8875-b3bfb9a505fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:32:04.816974 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3d18b-fc07-45c7-8875-b3bfb9a505fe service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:32:04.817252 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3d18b-fc07-45c7-8875-b3bfb9a505fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:32:04.817521 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3d18b-fc07-45c7-8875-b3bfb9a505fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:32:04.827776 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3d18b-fc07-45c7-8875-b3bfb9a505fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:32:04.829230 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3d18b-fc07-45c7-8875-b3bfb9a505fe service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:32:04.838768 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1454/2905] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:32:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:32:14.834426 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=26 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:44.061692 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:33:44.071063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e614bd-70e6-4346-ab82-8381a14147c9 service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:33:44.074607 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:33:44.075256 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:33:44.075483 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:33:44.075751 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:33:44.077512 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:33:44.087270 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:33:44.088708 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:33:44.097210 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1452/2906] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:33:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:33:54.093043 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:01.415934 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3d18b-fc07-45c7-8875-b3bfb9a505fe service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:34:01.425080 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3d18b-fc07-45c7-8875-b3bfb9a505fe service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:34:01.428661 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:34:01.429247 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:34:01.429523 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:34:01.429798 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:34:01.431673 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:34:01.446114 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:34:01.447512 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:34:01.458342 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1455/2907] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:34:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:34:02.638546 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:34:02.639977 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:34:02.650772 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846062d-62ae-46df-b5e4-238e2af49eb2 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:34:02.654318 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:34:02.654903 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:34:02.655179 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:34:02.655451 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:34:02.657446 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:34:02.670099 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:34:02.671516 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:34:02.683000 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1453/2908] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:34:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:34:11.453399 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=6 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:12.678231 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:14.943822 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:34:14.952556 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2ac16-3dfb-4ace-ae46-4214a7901004 service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:34:14.956520 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:34:14.957121 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:34:14.957402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:34:14.957675 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:34:14.959402 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:34:14.970231 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:34:14.971686 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:34:14.980324 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1456/2909] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:34:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:34:15.082518 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:34:15.091275 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4e197-f514-44c1-ad39-b52eb0ccc9c6 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:34:15.095583 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '512aab5a19c94651bfa0f634244dbdab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:34:15.096204 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:34:15.096514 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:34:15.096790 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:34:15.098618 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:34:15.112657 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:34:15.114063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:34:15.124795 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1454/2910] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:34:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:34:15.184941 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:34:15.197303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2e6c4-d585-4824-9b05-14b1fb30424a service neutron] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:34:15.202345 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:34:15.202959 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:34:15.203248 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:34:15.203519 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:34:15.205303 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:34:15.216589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:34:15.218155 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:34:15.228632 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1457/2911] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:34:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:34:16.247289 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:34:16.260120 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01a30-ff39-422d-866b-8d057485226f service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:34:16.266156 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:34:16.266955 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:34:16.267244 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:34:16.267529 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:34:16.269365 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:34:16.282127 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:34:16.283681 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:34:16.294639 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1455/2912] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:34:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:34:25.224332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=12 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:26.289712 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=12 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:41.444154 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:35:41.460752 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f87d04-5565-4223-b5e2-695a2ee76e88 service placement] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:35:41.469338 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e64f4c342e714597b6c628ca022d7b9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:35:41.470092 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:35:41.470507 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:35:41.471113 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:35:41.473013 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:35:41.486946 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:35:41.489347 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:35:41.501300 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1458/2913] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:35:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:35:50.317050 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:35:50.329063 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe04d8-46f1-4192-b1d4-95200b949fab service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:35:50.334213 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:35:50.334846 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:35:50.335129 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:35:50.335437 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:35:50.337168 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:35:50.349704 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:35:50.351943 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:35:50.363122 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1456/2914] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:35:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:35:51.496332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=6 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:54.213550 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:35:54.275907 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fe685-2db3-4882-96a0-9dccbc75f2ae service nova] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:35:54.280398 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:35:54.281019 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:35:54.281298 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:35:54.281569 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] PATH_INFO: `/v3/users/74eb7449794e4995a24027b10bb8a4e5` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:35:54.282669 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74eb7449794e4995a24027b10bb8a4e5)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:35:54.284583 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:35:54.435923 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74eb7449794e4995a24027b10bb8a4e5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:54.491291 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74eb7449794e4995a24027b10bb8a4e5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:54.492016 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74eb7449794e4995a24027b10bb8a4e5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:54.504117 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74eb7449794e4995a24027b10bb8a4e5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:54.504761 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74eb7449794e4995a24027b10bb8a4e5'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:54.517961 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1459/2915] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:35:54 2022] DELETE /identity/v3/users/74eb7449794e4995a24027b10bb8a4e5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:35:54.799083 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:35:54.810685 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c2d52-f844-45c7-b598-85754c53bc78 service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:35:54.869822 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:35:54.870462 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:35:54.870773 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:35:54.871076 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] PATH_INFO: `/v3/projects/0a1815ba253a4f1592e57f7f933813c5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:35:54.872195 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1815ba253a4f1592e57f7f933813c5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:35:54.874114 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:35:55.012326 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1815ba253a4f1592e57f7f933813c5', 'request_id': 'req-72ce7c47-9975-4516-9f38-b849d0c346b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.017756 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1815ba253a4f1592e57f7f933813c5', 'request_id': 'req-72ce7c47-9975-4516-9f38-b849d0c346b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.024900 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1815ba253a4f1592e57f7f933813c5', 'request_id': 'req-72ce7c47-9975-4516-9f38-b849d0c346b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.127153 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] The token cache is being invalidate because project 0a1815ba253a4f1592e57f7f933813c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:35:55.127439 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.128045 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.129585 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1457/2916] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:35:54 2022] DELETE /identity/v3/projects/0a1815ba253a4f1592e57f7f933813c5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:35:55.133627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:35:55.135125 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:35:55.148535 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d435-0131-4cb6-900f-04b262d4c242 admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:35:55.203162 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:35:55.203782 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:35:55.204059 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:35:55.204350 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] PATH_INFO: `/v3/users/d70d74094f904033a0e8f3dfd5b168e1` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:35:55.205448 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70d74094f904033a0e8f3dfd5b168e1)` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:35:55.207327 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:35:55.229427 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:55.406150 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70d74094f904033a0e8f3dfd5b168e1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.482359 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70d74094f904033a0e8f3dfd5b168e1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.482980 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70d74094f904033a0e8f3dfd5b168e1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.495589 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70d74094f904033a0e8f3dfd5b168e1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.496240 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.notifications [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70d74094f904033a0e8f3dfd5b168e1'} {{(pid=80613) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.508657 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1460/2917] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 10 11:35:55 2022] DELETE /identity/v3/users/d70d74094f904033a0e8f3dfd5b168e1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:35:55.775597 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:35:55.777172 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:35:55.790424 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7c47-9975-4516-9f38-b849d0c346b4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:35:55.849497 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c3d35f7ad34e87bf733354f4b0f781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3cc66b5da04b4f9bc679dee7bed60e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:35:55.850184 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:35:55.850422 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:35:55.850693 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] PATH_INFO: `/v3/projects/6efef4a4333f4472966bfafd148e44f1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:35:55.851828 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6efef4a4333f4472966bfafd148e44f1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:35:55.853776 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:35:55.875259 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:55.963467 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6efef4a4333f4472966bfafd148e44f1', 'request_id': 'req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.968835 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6efef4a4333f4472966bfafd148e44f1', 'request_id': 'req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:55.975126 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6efef4a4333f4472966bfafd148e44f1', 'request_id': 'req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:56.047604 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] The token cache is being invalidate because project 6efef4a4333f4472966bfafd148e44f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 11:35:56.047806 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:56.048448 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fbc98810-e74e-42bc-80ea-702f1c6aeb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 11:35:56.050046 dv-cinder-852724-1-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1458/2918] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 10 11:35:55 2022] DELETE /identity/v3/projects/6efef4a4333f4472966bfafd148e44f1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 11:36:05.504754 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:06.051413 dv-cinder-852724-1-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:36:52.339361 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] Authenticating user token {{(pid=80613) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 11:36:52.340936 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:36:52.409387 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178a7d-18cd-4d0d-aa05-581d9e5a26ae admin admin] Validating token access rules against request {{(pid=80613) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 11:36:52.467438 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ba68-86bc-4878-9787-af300ca8cb91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84db64968844438b96d04172cfd0e925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1f27fafd5a45ca9bbf07495fbcbe36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80613) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 11:36:52.468046 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ba68-86bc-4878-9787-af300ca8cb91 service placement] REQUEST_METHOD: `GET` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 11:36:52.468349 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ba68-86bc-4878-9787-af300ca8cb91 service placement] SCRIPT_NAME: `/identity` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 11:36:52.468627 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ba68-86bc-4878-9787-af300ca8cb91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80613) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 11:36:52.470332 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.fernet_utils [None req-f0c2ba68-86bc-4878-9787-af300ca8cb91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80613) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 11:36:52.482145 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ba68-86bc-4878-9787-af300ca8cb91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 11:36:52.483690 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ba68-86bc-4878-9787-af300ca8cb91 service placement] RBAC: Authorization granted {{(pid=80613) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 11:36:52.493963 dv-cinder-852724-1-smb devstack@keystone.service[80613]: [pid: 80613|app: 0|req: 1461/2919] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 10 11:36:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 11:37:02.489317 dv-cinder-852724-1-smb devstack@keystone.service[80613]: DEBUG dbcounter [-] [80613] Writing DB stats keystone:SELECT=58 {{(pid=80613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}